E-values enhance conformal prediction methods.
problem Distribution-free uncertainty quantification.
method Reformulation of conformal prediction using e-values.
result E-values offer new theoretical and practical capabilities.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “predictive values”
Fuzzy prediction sets generalize binary predictions to include elements at varying confidence levels.
problem Binary prediction sets are limited; fuzzy prediction sets offer richer guarantees.
method Generalize prediction sets to fuzzy sets, showing they are e-values with merging properties.
result Optimal e-values lead to optimal fuzzy prediction sets, including optimal conformal prediction.
PIVEN predicts both specific values and prediction intervals.
problem Improving robustness of neural nets in regression tasks.
method PIVEN is a deep neural network that produces both a prediction interval and a specific value prediction.
result PIVEN produces tighter uncertainty bounds than state-of-the-art approaches for prediction intervals.
DVA framework attributes value of predictive models to features, configurations, and interactions.
problem Lack of explanation for how predictive models influence operational decisions.
method Shapley-based cooperative game theory applied to predict-then-optimize systems.
result DVA can guide targeted interventions to align model beliefs with operational performance.
This paper improves fund net value prediction using ARIMA-LSTM hybrid model.
problem Inaccurate prediction of fund net value due to linear characteristics of models.
method ARIMA-LSTM hybrid model: ARIMA for linear characteristics, LSTM for nonlinear.
result Hybrid model shows higher accuracy in predicting fund net value.
The paper develops bounds for predictive values in binary classification.
problem Lack of confidence intervals for positive and negative predictive values.
method Bi-criterion framework and distribution-free large deviation and uniform convergence bounds.
result New bounds for predictive values without relying on concentration inequalities.
Paper improves conformal prediction for imprecise training data.
problem Applying conformal prediction to partially labeled data.
method Generalizes conformal prediction for set-valued training and calibration data.
result Validates the proposed method and shows it outperforms baselines.
A new method calibrates value predictions in offline RL to improve reliability.
problem Difficulty in long-horizon value prediction in offline reinforcement learning.
method Bellman calibration, a weak reliability criterion, and Iterated Bellman Calibration.
result Finite-sample guarantees show that Bellman calibration error is controlled at nonparametric rates.
Shapley value improves model interpretation but not causal inference.
problem Improving model interpretability without losing predictive power.
method Analyzed Shapley value in Bayesian networks, linking it to conditional independence.
result Eliminating high Shapley value variables does not harm predictive performance, but low Shapley value variables can.
Boosting framework for vector-valued prediction with geometric stability.
problem Lack of a general theoretical understanding of aggregation for structured prediction.
method Identifies -stability property and proposes a boosting framework based on exponential reweighting and geometric-median aggregation.
result Obtains exponential decay of empirical divergence error under weak learner condition and -stability.
A new conformal prediction framework for graph-valued outputs using Z-Gromov-Wasserstein distances.
problem Lack of principled uncertainty quantification for graph-valued supervised prediction.
method Proposes a conformal prediction framework using Z-Gromov-Wasserstein distances for graph-valued outputs.
result Provides distribution-free coverage guarantees for graph-valued outputs.
Study predicts soccer player market values using machine learning and SHAP for interpretability.
problem Predicting accurate market values for professional soccer players.
method Ensemble machine learning models, SHAP for interpretability, Boruta for feature selection.
result GBDT model achieved high predictive accuracy (R-squared 0.901, RMSE 3,221,632.175).
New framework predicts time series with missing values without imputation.
problem Predicting time series with missing values, especially when there's no ground truth for missing data.
method CRIB framework, combining attention mechanism and consistency regularization.
result CRIB framework predicts accurately even under high missing rates.
New method converts p-values to e-values for more efficient CP and aggregation.
problem Limitations of existing p-to-e calibrators in CP setting.
method Proposes a novel P2E calibrator for set-preserving calibration.
result Significant efficiency gains over existing p-to-e calibrators.
FavMac maximizes value while controlling cost in multi-label prediction.
problem Value-maximizing predictions with strict cost control in multi-label scenarios.
method FavMac pipeline combining any multi-label classifier with online update mechanism.
result FavMac achieves higher value with strict cost control compared to baselines.
The paper addresses the difficulty of decision makers trusting AI-assisted predictions and proposes a method to improve confidence values.
problem Decision makers struggle to trust AI-assisted predictions based on confidence values.
method The paper investigates why decision makers have difficulties and proposes a method to construct more useful confidence values.
result Multicalibration with respect to the decision maker's confidence on her own predictions is a sufficient condition for alignment, leading to better decisions.
A novel model combines deep learning and extreme value theory for multivariate cyber risk prediction.
problem High dimensionality and heavy tails in multivariate cyber risk patterns.
method Combines deep learning for point predictions and extreme value theory for quantile predictions.
result The model provides satisfactory high quantile predictions and accurate point predictions.
This paper discusses a counterpart of conformal prediction for e-values, conformal e-prediction. Conformal e-prediction is conceptually simpler and had been developed in the 1990s as a precursor of conformal prediction. When conformal prediction emerged as result of replacing e-values by p-values, it seemed to have imp…
Prediction-Powered E-Valuesstat.ML
Predictive e-values enhance statistical inference across various tasks.
problem Insufficient data limits traditional statistical inference.
method Apply prediction-powered inference to e-values.
result Every e-value-based inference has a prediction-powered counterpart.
Introduces joint Shapley values to measure feature importance in models.
problem Measuring the importance of feature sets in machine learning models.
method Extends Shapley's axioms to measure a set of features' average contribution to a model's prediction.
result Joint Shapley values provide unique insights and are more consistent with local intuitions.
Predictive Modeling: An Optimized and Dynamic Solution Framework for Systematic Value Investingq-fin.PM
This paper defines systematic value investing as an empirical optimization problem. Predictive modeling is introduced as a systematic value investing methodology with dynamic and optimization features. A predictive modeling process is demonstrated using financial metrics from Gray & Carlisle and Buffett & Clark. A 31-y…
New sampling methods improve Shapley values for explaining machine learning predictions.
problem Computational limitations in calculating Shapley values for complex models.
method Asymptotic normality results and paired-sampling approximations (KernelSHAP and PermutationSHAP).
result Paired-sampling PermutationSHAP provides exact results for interactions of maximal order two and has the additive recovery property.
We demonstrate that there is significant redundancy in the parameterization of several deep learning models. Given only a few weight values for each feature it is possible to accurately predict the remaining values. Moreover, we show that not only can the parameter values be predicted, but many of them need not be lear…
New method attributes feature uncertainty in ML models using cooperative game theory.
problem Lack of feature-level uncertainty attribution in explainable AI.
method Proposes a novel, model-agnostic uncertainty attribution method using cooperative game theory and conformal prediction.
result Demonstrates improved runtime efficiency and practical utility in real-world applications.
Study improves conformal prediction for missing covariate data.
problem Uncertainty quantification with missing covariate values.
method Generalized conformalized quantile regression framework, missing data augmentation.
result Improved prediction intervals valid conditionally to missing data patterns.
Paper uses Shapley values to explain how clusters of training data affect predictions.
problem Explaining how training data clusters impact predictions from black-box models.
method Extends Shapley values to cluster importance, using coalitional game theory.
result Shows how different clusters of training data contribute to model predictions.
Proposes a low-cost method to set hyperparameters using optimized default values.
problem Challenges of setting hyperparameters by trial and error, leading to subjective and inefficient results.
method Generates optimized default values using a small set of values that outperform existing defaults and tuned values.
result New default values deliver better predictive performance and are competitive with tuned values, making them easier to use.
Paper extends prediction-powered inference using conformal prediction for robust and valid imputation.
problem Safe use of black-box ML models for imputing missing data with strong guarantees.
method Connecting prediction-powered inference with conformal prediction for valid and additional guarantees.
result First general prediction-powered procedure for e-values operating off-line.
Machine learning models predict brain age with systematic bias, corrected in this study.
problem Systematic bias in machine learning regression models for brain age prediction.
method General constrained optimization approach to correct bias.
result Our method effectively eliminates the bias from brain age predictions.
New insights on Shapley value precision for tabular data predictions.
problem Precision of Shapley value explanations for individual observations.
method Conditional Shapley value estimation methods for tabular data.
result Shapley value explanations are less precise for outer observations.
Explaining complex or seemingly simple machine learning models is an important practical problem. We want to explain individual predictions from a complex machine learning model by learning simple, interpretable explanations. Shapley values is a game theoretic concept that can be used for this purpose. The Shapley valu…
Framework for joint learning of tasks on dementia data with missing values.
problem Lack of multi-task learning, handling time-dependent data, and missing values in dementia forecasting.
method Proposes SSHIBA model using Bayesian variational inference for imputation and combined information from different views.
result SSHIBA model outperforms baselines in predicting diagnosis, ventricle volume, and clinical scores in dementia.
A new method uses asymmetric Shapley values to assess gene importance in clinical prediction models.
problem Clinical prediction models struggle with assessing the importance of high-dimensional features like genomics.
method Derive efficient algorithms to compute local and global asymmetric Shapley values for a mixed-dimensional prediction model.
result Asymmetric Shapley values provide a more suitable alternative to quantify feature importance in clinical prediction models.
We adapt Shapley values to explain model uncertainty, connecting it to information theory.
problem Explaining uncertainty in model predictions.
method Adapted Shapley value framework to quantify feature contributions to predictive uncertainty.
result Deep connections between Shapley values and information theory quantities.
The study assesses the relative value of prediction in algorithmic decision making.
problem Improving welfare through better predictions versus other policy levers.
method Theoretical analysis of statistical models.
result Simple conditions determining the relative value of prediction.
This paper proposes a new approach to RL by focusing on the value-improvement path.
problem Value prediction problems in RL are sequence-dependent and require holistic approach.
method Characterize and approximate the value-improvement path holistically.
result A representation that spans the value-improvement path provides accurate value approximations for future policy improvements.
Paper predicts stock market values using machine learning.
problem Predicting stock market values for Tehran stock exchange groups.
method Used machine learning algorithms including Decision Tree, Bagging, Random Forest, Adaptive Boosting, Gradient Boosting, XGBoost, Artificial neural network, Recurrent Neural Network, and Long short-term memory (LSTM).
result LSTM shows highest accuracy among all algorithms tested.
This paper improves prediction accuracy for multi-input classification tasks using p-value aggregation.
problem Generating accurate predictive sets with guaranteed coverage for multi-input classification tasks.
method Integrates p-values from each observation to reduce the size of the predicted label set while maintaining class-conditional coverage.
result The method reduces the size of the predicted label set while preserving the required coverage guarantee.
FS-GCLSTM predicts stock returns by leveraging value-chain relationships.
problem Traditional time series models fail to capture complex interdependencies in modern markets.
method FS-GCLSTM integrates value-chain networks and graph convolutions to predict stock returns.
result FS-GCLSTM consistently delivers superior portfolio performance compared to traditional models.
Paper uses RNN to predict SaaS user lifetime value.
problem Predicting user lifetime value in SaaS applications.
method Recurrent Neural Network with multi-cell architecture, accounting for cohort, age-in-system, and contemporaneous information.
result Significantly improved prediction accuracy compared to existing models.
A method selects candidates based on predictions with statistical control.
problem Screening candidates for resource-intensive steps like hiring or drug discovery.
method Wraps around any prediction model to produce a subset of candidates with controlled false selection rate.
result Empirically demonstrates selection of candidates whose predictions exceed a data-dependent threshold.
The problem of machine learning with missing values is common in many areas. A simple approach is to first construct a dataset without missing values simply by discarding instances with missing entries or by imputing a fixed value for each missing entry, and then train a prediction model with the new dataset. A drawbac…
We describe the Customer LifeTime Value (CLTV) prediction system deployed at ASOS.com, a global online fashion retailer. CLTV prediction is an important problem in e-commerce where an accurate estimate of future value allows retailers to effectively allocate marketing spend, identify and nurture high value customers an…
In this paper, we formulate a method for minimising the expectation value of the procurement cost of electricity in two popular spot markets: {\it day-ahead} and {\it intra-day}, under the assumption that expectation value of unit prices and the distributions of prediction errors for the electricity demand traded in tw…
Market forecasts converge to true values if some agents are correct.
problem Convergence of market forecasts in dynamic prediction markets.
method Dynamic model of prediction market with agents making forecasts.
result Aggregated market forecasts converge to conditional expectations.
GAS models have been recently proposed in time-series econometrics as valuable tools for signal extraction and prediction. This paper details how financial risk managers can use GAS models for Value-at-Risk (VaR) prediction using the novel GAS package for R. Details and code snippets for prediction, comparison and back…
Paper uses VAEAC to estimate Shapley values for complex models with mixed features.
problem Estimating Shapley values for models with dependent mixed features.
method Uses variational autoencoder with arbitrary conditioning (VAEAC) to model feature dependencies.
result VAEAC approach outperforms state-of-the-art methods for various settings.
Unified framework for set-valued classification tackles ambiguous multi-class datasets.
problem Ambiguous multi-class datasets in modern statistics.
method Unified statistical framework encompassing various set-valued classification formulations.
result Infinite sample optimal strategies and plug-in principle for data-driven algorithms.