Paper extends prediction-powered inference using conformal prediction for robust and valid imputation.
problem Safe use of black-box ML models for imputing missing data with strong guarantees.
method Connecting prediction-powered inference with conformal prediction for valid and additional guarantees.
result First general prediction-powered procedure for e-values operating off-line.
PPBoot simplifies prediction-powered inference.
problem Prediction-powered inference problems.
method Bootstrap-based method for arbitrary estimation problems.
result PPBoot often performs nearly identically to PPI(++).
Valid inference from data and predictions.
problem Valid statistical inference with machine learning predictions.
method Framework for valid inference using machine learning predictions.
result Valid confidence intervals without assumptions on predictions.
Predictive e-values enhance statistical inference across various tasks.
problem Insufficient data limits traditional statistical inference.
method Apply prediction-powered inference to e-values.
result Every e-value-based inference has a prediction-powered counterpart.
New definition reveals encoding explanations that retain predictive power.
problem Challenges in evaluating and identifying encoding explanations.
method Developed a definition of encoding based on conditional dependence.
result Existing evaluation scores do not rank non-encoding explanations correctly, but STRIPE-X does.
Extends PPI to sequential setting, improving inference over time.
problem Sequential data growth with unlabelled data.
method Prediction-powered confidence sequence procedures using Ville's inequality and the method of mixtures.
result Asymptotically valid uniformly over time, accommodating prior knowledge.
SAGE quantifies feature importance in machine learning models.
problem Understanding the role of individual features in complex models.
method Formalizing predictive power through model-based and universal measures, and introducing SAGE for efficient calculation.
result SAGE assigns more accurate feature importance values than other methods.
FPPI selectively uses predictions to improve inference efficiency.
problem Improving statistical inference with limited labeled data and heterogeneous prediction quality.
method Filtered Prediction-Powered Inference (FPPI) framework.
result FPPI achieves strictly improved asymptotic efficiency compared to existing methods.
FAB-PPI uses prior knowledge to improve prediction-powered inference.
problem Improving statistical inference with machine learning predictions.
method Informing PPI with prior knowledge on prediction quality.
result FAB-PPI improves inference accuracy and confidence intervals.
StratPPI improves prediction-powered inference with stratified sampling.
problem Improving statistical estimates with limited human-labeled data.
method Combining small human-labeled data with large automatic-labeled data, stratifying data for tighter confidence intervals.
result StratPPI provides substantially tighter confidence intervals than unstratified approaches.
This research evaluates measures of dependence for financial time-series data.
problem Accurately preparing time series data and selecting an appropriate measure of dependence is challenging.
method Review and establishment of a comprehensive analysis framework for shaping time-series data and evaluating measures of dependence.
result A method, framework, and example for selecting and evaluating a suitable measure of dependence are presented.
PPI++ uses machine learning predictions to improve inference from small datasets.
problem Efficient inference from small labeled datasets with high-quality predictions.
method Adapts prediction-powered inference (PPI) to compute confidence sets for any parameter dimensionality.
result Improves classical intervals using only labeled data, always yielding better results.
PAS improves estimation of multiple means using ML predictions and shrinkage.
problem Improving statistical estimates with limited gold-standard data and noisy ML predictions.
method Prediction-Powered Adaptive Shrinkage (PAS) that combines PPI with empirical Bayes shrinkage.
result PAS adapts to the reliability of ML predictions and outperforms traditional methods in large-scale applications.
New analysis shows ROI's predictive power for stock returns weakens significantly.
problem The predictive power of retail order imbalance (ROI) for future stock returns.
method Replicated Boehmer et al. (2021) using a more recent period and analyzed the effect of using alternative quote midpoint (QMP) method.
result Past ROI can no longer predict weekly returns on large-cap stocks, and the long-short strategy based on past ROI is no longer profitable.
Investor sentiment improves model accuracy but complexity doesn't always boost predictive power.
problem Determining the optimal complexity of investor sentiment measures in asset pricing models.
method Comprehensive review of 71 papers from 2000-2021, analyzing various sentiment measures and models.
result Higher complexity of sentiment measures does not necessarily improve predictive power.
Study improves treatment effect estimation using unlabeled covariates.
problem Estimating treatment effects with limited labeled data.
method Developed efficiency bounds and estimators for semi-supervised setting.
result Estimators using unlabeled covariates have lower asymptotic variance.
PPAT uses predictions to improve risk estimation in active testing.
problem Exploiting informative predictions from black-box models for efficient risk estimation.
method Combines LURE estimator with prediction-powered control variate.
result PPAT outperforms existing methods in risk estimation and uncertainty quantification.
The paper improves decision tree stability for health care applications.
problem Stability of decision trees in health care applications.
method Introducing a new distance metric to determine tree stability and proposing a novel training methodology.
result On average, a 4.6% decrease in predictive power yields a 38% increase in model stability.
We use supervised learning to identify factors that predict the cross-section of returns and maximum drawdown for stocks in the US equity market. Our data run from January 1970 to December 2019 and our analysis includes ordinary least squares, penalized linear regressions, tree-based models, and neural networks. We fin…
Generalizes prediction-powered inference for binary classifier evaluation.
problem Evaluation of binary classifiers with partially observed outcomes.
method Generalizes PPI to any regular asymptotically linear estimator and proposes modified estimators for covariate shift.
result PPI can be a computationally-simple alternative to existing methods, achieving no greater than the semi-parametric efficiency lower bound in certain scenarios.
A framework uses a mixture of predictors for semi-supervised inference.
problem Limited labeled data, abundant unlabeled data.
method Mixture of Experts (MOE) for semi-supervised inference.
result MOE-powered inference framework achieves smallest possible variance.
Machine learning algorithms aim at minimizing the number of false decisions and increasing the accuracy of predictions. However, the high predictive power of advanced algorithms comes at the costs of transparency. State-of-the-art methods, such as neural networks and ensemble methods, often result in highly complex mod…
Improved local multivariable regression for better inference with limited data.
problem Limited sample size hampers local polynomial/multivariable regression.
method Prediction-Powered Inference (PPI) algorithm for local multivariable regression.
result Significantly reduces estimation variance without increasing error.
Proposes a tabular transformer model to maintain feature effect intelligibility.
problem Losing marginal feature effects in deep tabular transformer networks.
method Adapts tabular transformer networks to identify marginal feature effects.
result The model accurately identifies marginal feature effects, matching black-box performance while maintaining intelligibility.
Paper explains DRL strategies for portfolio management using linear models.
problem Difficulty in understanding DRL-based trading strategies.
method Empirical approach using linear models and integrated gradients.
result DRL agents show stronger multi-step prediction power than machine learning methods.
This study investigates empirically whether the degree of stock market efficiency is related to the prediction power of future price change using the indices of twenty seven stock markets. Efficiency refers to weak-form efficient market hypothesis (EMH) in terms of the information of past price changes. The prediction …
PPI uses predictions and weighting to infer from partially labeled data.
problem Valid inference with partially labeled data.
method Combines model-based predictions with bias correction from labeled data, using Horvitz-Thompson and Hájek corrections.
result IPW-adjusted PPI with estimated propensities performs similarly to known-probability case.
Unified approach combines prediction-powered inference and variance reduction for semi-supervised optimization.
problem Scarcity of labeled data in semi-supervised optimization.
method PPI-SVRG, combining PPI and SVRG methods.
result Unified convergence bound with improved performance under label scarcity.
AM-PPI uses multiple predictors to reduce label cost in healthcare AI.
problem Reduces label cost in post-deployment monitoring of healthcare AI.
method Combines model predictions with a small labeled sample, routing each instance to a cost-appropriate subset of predictors.
result Produces narrower confidence intervals than single-predictor methods.
Conditional independence testing is a key problem required by many machine learning and statistics tools. In particular, it is one way of evaluating the usefulness of some features on a supervised prediction problem. We propose a novel conditional independence test in a predictive setting, and show that it achieves bet…
NAMLSS models provide interpretable neural regression for location, scale, and shape.
problem Lack of interpretability in deep learning models for complex data distributions.
method Combines classical statistical methods with DNNs for distributional regression.
result Achieves visual interpretability and predictive power of deep learning models.
Over the years, ensemble methods have become a staple of machine learning. Similarly, generalized linear models (GLMs) have become very popular for a wide variety of statistical inference tasks. The former have been shown to enhance out- of-sample predictive power and the latter possess easy interpretability. Recently,…
TLRS improves predictive power of mined formulaic alpha factors.
problem Sparse rewards in RL for mining formulaic alpha factors.
method Trajectory-level Reward Shaping (TLRS) with reward centering.
result TLRS boosts predictive power by 9.29% over existing methods.
PPI uses proxy data to improve inference from limited labels across related tasks.
problem Statistical inference with limited labels across multiple related tasks.
method Prediction-powered inference framework that uses cross-task recalibration to improve power and accuracy.
result Cross-task recalibration can substantially reduce confidence interval widths when labels are scarce.
New method uses machine learning to improve statistical inference.
problem Performing inference on conditional functionals with scarce labeled data.
method Combines localization with prediction-based variance reduction.
result Valid and sharp confidence intervals for conditional functionals.
We report a neural architecture search framework, BioNAS, that is tailored for biomedical researchers to easily build, evaluate, and uncover novel knowledge from interpretable deep learning models. The introduction of knowledge dissimilarity functions in BioNAS enables the joint optimization of predictive power and bio…
The study examines how global economic policy uncertainty affects crude oil futures volatility.
problem Predicting crude oil futures volatility using global economic policy uncertainty.
method Established single-factor and two-factor models under the GARCH-MIDAS framework, tested with rolling-window and fixed-span specifications.
result GEPU changes have stronger predictive power than the GEPU index for crude oil futures volatility.
The paper develops deep learning models for personalized treatment rules in survival analysis.
problem Deriving optimal treatment rules for bivariate survival outcomes in randomized trials.
method Adaptive prediction-powered learning using deep neural networks and stochastic policies.
result Maximizes joint survival probability beyond fixed time points (t1,t2). Log-ergodic model improves velocity of money prediction.
problem Improving velocity of money prediction for economic control.
method Log-ergodic processes to simulate monetary velocity.
result Log-ergodic model offers superior predictive power.
Stacking methods improve the prediction performance of regression models. A simple way to stack base regressions estimators is by combining them linearly, as done by \citet{breiman1996stacked}. Even though this approach is useful from an interpretative perspective, it often does not lead to high predictive power. We pr…
To cure the lack of predictive power of general relativity Geroch proposed to complete the theory with an additional postulate that only "hole-free" spacetimes are permitted. I argue that this postulate is too strong -- it prohibits even the Minkowski space.
FDNet learns PDEs from data with fast predictions.
problem Discovering complex systems behavior from data.
method Finite difference neural networks (FDNet) to learn PDEs from trajectory data.
result FDNet predicts future behavior with few trainable parameters.
Novel method combines neural network features with survival models for ICU infections.
problem Improving predictive models of ICU infections while maintaining interpretability.
method Semi-parametric approach combining low-resolution and high-resolution data.
result Improved predictive power with interpretability maintained.
Automates finding interactions in GLMs using neural networks.
problem Time-consuming and expert-dependent search for GLM interactions.
method Neural networks and model-specific interaction detection method.
result Computational speed improvement over traditional methods.
New method improves deep learning models' uncertainty estimates.
problem Overconfidence in deep learning predictions.
method Develops a novel training algorithm using conformal inference.
result Produces more reliable uncertainty estimates without sacrificing accuracy.
Cross-prediction improves inference from small labeled datasets.
problem Valid inference from small labeled datasets with imperfect predictions.
method Imputes missing labels via machine learning and debiases predictions.
result Inferences achieve desired error probability and are more powerful.
Prediction-powered causal inference achieves smaller asymptotic variance than traditional methods.
problem Estimating causal and structural parameters in a semi-supervised setting.
method Combining efficient influence function with debiased machine learning and semi-supervised Riesz regression.
result Asymptotic variances of estimators match the derived efficiency bound.
PPI uses predictions to improve inference from incomplete data.
problem Incomplete or costly-to-measure outcomes in research fields.
method Leverages large unlabeled datasets for improved statistical efficiency with bias correction.
result PPI variants produce tighter confidence intervals than complete-case analysis.