Prediction problems often admit competing models that perform almost equally well. This effect challenges key assumptions in machine learning when competing models assign conflicting predictions. In this paper, we define predictive multiplicity as the ability of a prediction problem to admit competing models with confl…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Prediction Problems”
The paper emphasizes the importance of joint predictions over marginal predictions for decision-making.
problem The need for accurate joint predictions in decision-making problems.
method The paper analyzes combinatorial decision problems, sequential predictions, and multi-armed bandits, introducing an approximate Thompson sampling algorithm and new regret bounds.
result Accurate joint predictions are essential for good performance in decision-making problems.
The paper tackles fast rates in structured prediction problems.
problem Structured prediction problems with discrete outputs.
method Introducing continuous surrogate problems and leveraging their convergence rates for discrete problems.
result Super fast rates, including exponential rates, for excess risk in structured prediction problems.
Decision trees improve decision-making by optimizing predictions of unknown parameters.
problem Optimizing decisions based on predicted unknown parameters.
method SPO Trees (SPOTs) for training decision trees under the SPO loss function.
result SPOTs provide higher quality decisions and significantly lower model complexity compared to other machine learning approaches.
dboost optimizes prediction models for convex cone problems.
problem Optimizing prediction models for decision-making.
method Gradient boosting with implicit differentiation for convex quadratic cone programming.
result dboost reduces out-of-sample decision regret.
Student performance prediction - where a machine forecasts the future performance of students as they interact with online coursework - is a challenging problem. Reliable early-stage predictions of a student's future performance could be critical to facilitate timely educational interventions during a course. However, …
Study examines how imputation accuracy affects prediction accuracy in regression problems with missing covariates.
problem Missing covariates in regression or classification problems.
method Simulation and empirical analysis using UCI datasets and statistical inference.
result Imputation accuracy impacts prediction accuracy, especially with Machine Learning methods.
This paper offers a methodological contribution at the intersection of machine learning and operations research. Namely, we propose a methodology to quickly predict expected tactical descriptions of operational solutions (TDOSs). The problem we address occurs in the context of two-stage stochastic programming where the…
Conformal predictive systems are a recent modification of conformal predictors that output, in regression problems, probability distributions for labels of test observations rather than set predictions. The extra information provided by conformal predictive systems may be useful, e.g., in decision making problems. Conf…
Many real-world analytics problems involve two significant challenges: prediction and optimization. Due to the typically complex nature of each challenge, the standard paradigm is predict-then-optimize. By and large, machine learning tools are intended to minimize prediction error and do not account for how the predict…
New methods improve prediction intervals across multiple environments.
problem Valid confidence intervals and sets in multi-environment prediction.
method Extended jackknife and split-conformal methods, with resizing for problem difficulty.
result Distribution-free coverage achieved in non-traditional data scenarios.
Deep learning predicts baseball home runs with better accuracy.
problem Predicting player performance in baseball.
method Long Short-Term Memory (LSTM) neural network.
result LSTM outperformed other models in predicting home runs.
When faced with the problem of learning a model of a high-dimensional environment, a common approach is to limit the model to make only a restricted set of predictions, thereby simplifying the learning problem. These partial models may be directly useful for making decisions or may be combined together to form a more c…
New method learns output embeddings for structured prediction.
problem Structured prediction with output embeddings.
method Jointly learns output embedding and regression function.
result Structured predictor is a consistent estimator with smaller complexity.
In this paper, we study the novel problem of not only predicting ingredients from a food image, but also predicting the relative amounts of the detected ingredients. We propose two prediction-based models using deep learning that output sparse and dense predictions, coupled with important semi-automatic multi-database …
Equivariant networks improve geometric prediction without scalar approximations.
problem Efficiently predicting geometric tensors in real-world scenarios.
method Equivariant networks for geometric prediction.
result Equivariant networks can generalize to unseen systems for geometric prediction.
Proposes a cGAN-based model for probabilistic predictions and uncertainty estimation.
problem Deterministic predictions in ANNs limit their use in fields requiring uncertainty.
method Reverses cGAN structure for probabilistic prediction, introduces entropy for uncertainty measurement.
result Superior estimation performance, especially on noisy data.
New model predicts multiple future trends from merchant transactions.
problem Predicting multiple future trends from merchant transaction history.
method Convolutional neural networks and encoder-decoder structure.
result Demonstrated effectiveness in predicting multiple future trends.
Paper integrates predictive and prescriptive tasks using bilevel optimization.
problem Combining prediction and decision-making in machine learning.
method Bilevel optimization for integrating predictive and prescriptive tasks.
result Improved decision-making through direct integration of predictions.
This paper offers a methodological contribution at the intersection of machine learning and operations research. Namely, we propose a methodology to quickly predict tactical solutions to a given operational problem. In this context, the tactical solution is less detailed than the operational one but it has to be comput…
This paper provides a ML framework for diabetes prediction and care management.
problem Diabetes prediction and care management challenges in real-world healthcare.
method Illustrates a Machine Learning framework for T2DM prediction and risk stratification.
result ML models align with physician's disease management steps.
Multi-output prediction deals with the prediction of several targets of possibly diverse types. One way to address this problem is the so called problem transformation method. This method is often used in multi-label learning, but can also be used for multi-output prediction due to its generality and simplicity. In thi…
We study the problem of structured prediction under test-time budget constraints. We propose a novel approach applicable to a wide range of structured prediction problems in computer vision and natural language processing. Our approach seeks to adaptively generate computationally costly features during test-time in ord…
FakeEdge tackles dataset shift in link prediction tasks.
problem Dataset shift between training and testing sets in link prediction.
method Model-agnostic technique to mitigate graph topological gap.
result Extensive experiments show FakeEdge's superiority on multiple datasets.
The paper proposes a method for valid multi-target regression predictions.
problem Valid multi-variate predictions for multi-target regression.
method Copula functions applied to deep neural networks for inductive conformal prediction.
result The proposed method ensures efficiency and validity for multi-target regression problems.
When faced with a supervised learning problem, we hope to have rich enough data to build a model that predicts future instances well. However, in practice, problems can exhibit predictive heterogeneity: most instances might be relatively easy to predict, while others might be predictive outliers for which a model train…
The paper tackles entry prediction in row/column-exchangeable matrices with arbitrary missing data.
problem Prediction in matrices with arbitrary missing data.
method Proposes two practical algorithms: one for fast emulation and another for acceleration using algorithmic stability.
result Demonstrates superior performance in synthetic and real-world data sets.
We consider the link prediction problem in a partially observed network, where the objective is to make predictions in the unobserved portion of the network. Many existing methods reduce link prediction to binary classification problem. However, the dominance of absent links in real world networks makes misclassificati…
Paper uses CNN to predict stock price movement as an image classification problem.
problem Predicting stock price movement using machine learning.
method CNN-based model for classifying stock price movement based on the first hour of trading.
result The algorithm effectively separated between stock price movement classes and outperformed other strategies.
In silico drug-target interaction (DTI) prediction is an important and challenging problem in biomedical research with a huge potential benefit to the pharmaceutical industry and patients. Most existing methods for DTI prediction including deep learning models generally have binary endpoints, which could be an oversimp…
Blood lactate concentration is a strong indicator of mortality risk in critically ill patients. While frequent lactate measurements are necessary to assess patient's health state, the measurement is an invasive procedure that can increase risk of hospital-acquired infections. For this reason we formally define the prob…
Generative AI can solve in-context learning problems using a martingale perspective.
problem Estimating when a conditional generative model can solve an in-context learning problem.
method Bayesian interpretation, ancestral sampling, generative predictive p-value.
result Developed a method to assess the suitability of CGMs for ICL problems using generative predictive p-values.
The paper offers a method to create prediction sets with uncertainty control.
problem Calibrating and communicating uncertainty in machine learning predictions.
method Distribution-free, risk-controlling prediction sets using a holdout set to calibrate set sizes.
result Explicit finite-sample guarantees for error control in various machine learning tasks.
Fundamental Limits of Prediction, Generalization, and Recursion: An Entropic-Innovations Perspectivecs.LG
In this paper, we examine the fundamental performance limits of prediction, with or without side information. More specifically, we derive generic lower bounds on the norms of the prediction errors that are valid for any prediction algorithms and for any data distributions. Meanwhile, we combine the ent…
Predictive Banditscs.LG
New predictive bandit model with noise for better decision making.
problem Optimizing decisions with limited information and noise.
method Introduced predictive bandits, derived regret bounds, and developed algorithms.
result Developed algorithms matching theoretical regret bounds.
New approach optimizes decisions based on uncertainty in predictions.
problem Mismatch between prediction accuracy and decision loss in sequential design.
method Directional uncertainty-guided approach to sequential experimental design.
result Directional uncertainty-based design stops earlier and performs better.
This paper investigates different vector step-size adaptation approaches for non-stationary online, continual prediction problems. Vanilla stochastic gradient descent can be considerably improved by scaling the update with a vector of appropriately chosen step-sizes. Many methods, including AdaGrad, RMSProp, and AMSGra…
A new framework learns differentiable structured losses from data.
problem Learning effective losses for complex structured prediction tasks.
method Contrastive learning to learn differentiable structured losses from output data.
result Achieves similar or better performance than kernel-based methods.
In its simplest form, the traffic flow prediction problem is restricted to predicting a single time-step into the future. Multi-step traffic flow prediction extends this set-up to the case where predicting multiple time-steps into the future based on some finite history is of interest. This problem is significantly mor…
This paper addresses a multi-label predictive fault classification problem for multidimensional time-series data. While fault (event) detection problems have been thoroughly studied in literature, most of the state-of-the-art techniques can't reliably predict faults (events) over a desired future horizon. In the most g…
Study tackles imbalanced data in car insurance claims prediction.
problem Predicting rare events (claims) in car insurance with imbalanced data.
method Various machine learning techniques (logistic-regression, decision tree, random forest, xgBoost, feed-forward network) applied to imbalanced dataset.
result Comparison of machine learning algorithms' performance in claim occurrence prediction.
The article proposes a method to make valid insurance claim predictions without relying on specific models.
problem Prediction of insurance claims using statistical models can be unreliable due to model misspecification, selection effects, and lack of finite-sample validity.
method The article employs conformal prediction, a machine learning strategy that is model-free and tuning-parameter-free, ensuring finite-sample validity.
result The proposed method guarantees valid predictions at a pre-assigned coverage probability level and performs well in insurance applications, including meeting Solvency II requirements.
This thesis improves protein contact prediction using unsupervised and supervised methods.
problem Improving accuracy of protein contact prediction.
method Unsupervised and supervised deep learning methods.
result A scoring system called diversity score for measuring contact novelty.
Motivated by Supervised Opinion Analysis, we propose a novel framework devoted to Structured Output Learning with Abstention (SOLA). The structure prediction model is able to abstain from predicting some labels in the structured output at a cost chosen by the user in a flexible way. For that purpose, we decompose the p…
Study evaluates ensemble methods for zero-shot uncertainty quantification with diffusion models.
problem Quantifying uncertainty in zero-shot regression problems using diffusion models.
method Used diffusion probabilistic models for ensemble prediction and evaluated their effectiveness on various regression tasks.
result Ensemble methods consistently improve model prediction accuracy across different regression tasks.
Massively multi-label prediction/classification problems arise in environments like health-care or biology where very precise predictions are useful. One challenge with massively multi-label problems is that there is often a long-tailed frequency distribution for the labels, which results in few positive examples for t…
GEN tackles few-shot out-of-graph link prediction in evolving multi-relational graphs.
problem Predicting links between unseen nodes in evolving multi-relational graphs with few edges per node.
method Transductive meta-learning framework (GEN) for inductive and transductive inference.
result GEN significantly outperforms relevant baselines for out-of-graph link prediction tasks.
Conditional independence testing is a key problem required by many machine learning and statistics tools. In particular, it is one way of evaluating the usefulness of some features on a supervised prediction problem. We propose a novel conditional independence test in a predictive setting, and show that it achieves bet…