The paper proposes a method to predict the performance of data-driven algorithms using surrogate models.
problem Improving the performance prediction of data-driven knowledge discovery algorithms.
method Surrogate-assisted performance prediction using evolutionary modeling of clinical pathways.
result The proposed approach provides interpretable prediction of algorithm performance and quality.
ICP improves text infilling and POS tagging with valid confidence sets.
problem Statistical reliability of machine learning predictions.
method Inductive conformal prediction algorithms for text infilling and POS tagging.
result Valid set-valued predictions with small size for real-world applications.
New approach for algorithms that learn predictors to improve performance.
problem Improving algorithm performance by learning better predictions.
method Identify functional dependence and apply online learning techniques.
result Improved results in various online settings with simpler analysis.
New algorithms for hierarchical classification using conformal prediction.
problem Valid prediction sets in hierarchical classification tasks.
method Extended split conformal prediction framework with two inference algorithms.
result Empirical evaluations show effectiveness in achieving nominal coverage.
Paper uses AI to predict stock market volatility with neural networks and genetic algorithms.
problem Traditional methods for predicting stock market volatility have high errors.
method Back-propagation neural network and genetic algorithm integrated model.
result The model predicts future volatility with low errors and high accuracy.
Survey of algorithms to correct past mistakes in prediction.
problem Improving prediction accuracy by correcting past errors.
method Defensive Forecasting as a sequential game theory approach to minimize prediction metrics.
result Simple, near-optimal algorithms for various prediction tasks.
Proposes a score to compare rule-based algorithms' interpretability.
problem Lack of consensus on interpretability for predictive models.
method Defines a score with three terms: predictivity, stability, and simplicity, each quantified by simple formulas.
result Compares interpretability of rule-based and tree-based algorithms for regression and classification.
The paper proposes calibration to improve algorithm performance using machine learning predictions.
problem Improving real-world performance of online algorithms with machine learning predictions.
method Calibration as a tool to bridge the gap between prediction uncertainty and algorithm design.
result Calibrated advice leads to more effective guidance in high-variance settings and significant performance improvements in real-world data.
We present and test a sequential learning algorithm for the short-term prediction of human mobility. This novel approach pairs the Exponential Weights forecaster with a very large ensemble of experts. The experts are individual sequence prediction algorithms constructed from the mobility traces of 10 million roaming mo…
Framework uses human judgment to distinguish algorithmically indistinguishable cases.
problem Clarifying human-AI collaboration in prediction and decision tasks.
method Integrates human judgment to distinguish algorithmically indistinguishable cases.
result Improves performance of any feasible algorithmic predictor.
A new algorithm for time series prediction intervals.
problem Non-exchangeability in time series data.
method Adaptive re-estimation of non-conformity scores.
result Significant reduction in interval width compared to existing methods.
Algorithm constructs prediction sets with PAC guarantees in label shift settings.
problem Reliable uncertainty quantification in the face of distribution shift.
method Estimates predicted probabilities and confusion matrix, then propagates uncertainty through Gaussian elimination to compute confidence intervals and construct prediction sets.
result Satisfies PAC guarantees and produces smaller, more informative prediction sets.
Generalized algorithm for translation and scale-invariant prediction.
problem Sequential prediction with expert advice, focusing on translation and scale invariance.
method Designing a generalized online algorithm using the universal prediction perspective to compete against a generic class of expert selection strategies.
result No preliminary knowledge of loss sequences is required; performance bounds are stable under arbitrary scalings and translations.
This paper compares ML algorithms for PD prediction, finding XGBoost to be the most effective.
problem Predicting the probability of default in loan portfolios.
method Comparison of five ML algorithms (Random Forests, Decision Trees, XGBoost, Gradient Boosting, AdaBoost) with logistic regression.
result XGBoost outperforms other ML algorithms for PD prediction.
New method handles correlated genes for better genomic prediction.
problem Technical issues with highly correlated genes in prediction models.
method Grouping algorithm that treats correlated genes as a group and uses their common patterns.
result Significantly outperforms standard models in prediction and feature selection.
K-means algorithm improves financial market risk prediction accuracy.
problem High error rate and low precision in financial market risk prediction.
method Applied K-means algorithm in machine learning to financial market risk forecasting.
result Achieved a 94.61% accuracy rate in financial market risk prediction.
This work uses PAC-Bayes for structured prediction with ILE, yielding insights and algorithms.
problem Structured prediction with interdependent outputs and implicit loss embeddings.
method PAC-Bayes perspective applied to ILE framework, deriving generalization bounds and learning algorithms.
result Two learning algorithms derived from PAC-Bayes bounds, analyzed and implemented.
A new predictive coding algorithm improves machine learning performance.
problem Improving performance of variational inference algorithms in high-dimensional, structured problems.
method Divide-and-Conquer Predictive Coding (DCPC) that respects generative model correlation structure and performs maximum-likelihood updates.
result DCPC achieves better numerical performance and accurate inference in structured generative models.
New algorithm for efficient prediction intervals in neural networks.
problem Challenges in estimating uncertainty in neural network predictions.
method Applies matrix sketching to approximate Jacobian matrix for efficient uncertainty estimation.
result Produces approximate prediction intervals with competitive performance.
LINTEL improves INTEL's time series prediction by optimizing computation and accuracy.
problem Online prediction of time series with regime switching and outliers.
method Gaussian process-based approach with exact filtering distribution and constant-time updates.
result LINTEL is over five times faster with better quality predictions.
Algorithm generates adaptive confidence sets for instance segmentation with guaranteed coverage.
problem Uncalibrated predictions and lack of uncertainty quantification in instance segmentation models.
method Conformal prediction algorithm to generate adaptive confidence sets with provable guarantees.
result Empirically, prediction sets vary in size based on query difficulty and attain target coverage, outperforming baselines.
New algorithm reduces regret and constraint violation in online convex optimization with predictions.
problem Online convex optimization with time-varying constraints and predictions.
method Primal-dual algorithm combining Follow-The-Regularized-Leader with adaptive steps.
result Achieves O(T43−β) regret and O(T21+β) constraint violation bounds. New algorithm speeds up RNN time series prediction by filtering noise.
problem Predicting smooth trajectories from noisy time series data.
method Analyzed RNN dynamics to propose an efficient noise filtering algorithm.
result Significant speedup in predictive process without accuracy loss.
New method detects data distribution changes and retraining is advised.
problem Detecting when data distribution changes for retraining prediction algorithms.
method Exchangeable martingales and conformal prediction.
result Guaranteed validity of the method, with efficiency explored.
New algorithms improve privacy-preserving data release using external predictions.
problem Privacy-preserving data release with improved utility using external information.
method Learning-augmented algorithms for multiple quantile release.
result Error guarantees scale with prediction quality, almost recovering state-of-the-art guarantees.
Gradient-based algorithm improves model performance with triage.
problem Improving model accuracy with human expert involvement.
method Formal characterization of triage, optimal triage policy as deterministic threshold rule, gradient-based algorithm.
result Gradient-based algorithm finds triage policies and models with increasing performance.
The study assesses the relative value of prediction in algorithmic decision making.
problem Improving welfare through better predictions versus other policy levers.
method Theoretical analysis of statistical models.
result Simple conditions determining the relative value of prediction.
New algorithms improve time series prediction with uncertainty quantification.
problem Uncertainty quantification for time series prediction.
method Combines conformal prediction and control theory for online, adaptive forecasting.
result Improves coverage over ensemble forecasters in real-world applications.
In this paper, a method of prediction on continuous time series variables from the production or flow -- an LSTM algorithm based on multivariate tuning -- is proposed. The algorithm improves the traditional LSTM algorithm and converts the time series data into supervised learning sequences regarding industrial data's f…
We present a framework to train a structured prediction model by performing smoothing on the inference algorithm it builds upon. Smoothing overcomes the non-smoothness inherent to the maximum margin structured prediction objective, and paves the way for the use of fast primal gradient-based optimization algorithms. We …
We present a predictor-corrector framework, called PicCoLO, that can transform a first-order model-free reinforcement or imitation learning algorithm into a new hybrid method that leverages predictive models to accelerate policy learning. The new "PicCoLOed" algorithm optimizes a policy by recursively repeating two ste…
Proposes a test to ensure predictive algorithms predict intended outcomes better than unintended ones.
problem Unintended model behavior leading to prediction of unintended outcomes.
method Falsification framework using nonparametric hypothesis testing to compare prediction losses across outcomes.
result Establishes discriminant validity with respect to gender but not race in an admissions setting.
Study of online learning for structured prediction problems.
problem Structured prediction in online learning settings.
method Developed algorithms for structured prediction in online learning, generalizing from supervised learning.
result Achieved the same excess risk upper bound for non-i.i.d. data and bounded the stochastic regret for non-stationary data.
Online algorithms stabilize in feedback loops of performative prediction.
problem Feedback loops in algorithmic predictions influence data distributions.
method Martingale argument and randomization to avoid distributional assumptions.
result No-regret algorithms converge to performatively stable equilibria.
The optimal learner for prediction modeling varies depending on the underlying data-generating distribution. Super Learner (SL) is a generic ensemble learning algorithm that uses cross-validation to select among a "library" of candidate prediction models. The SL is not restricted to a single prediction model, but uses …
A novel algorithm predicts customized allergy seasons using multi-variate triple-regression.
problem Predicting customized allergy seasons for individual patients.
method Triple-regression algorithm with pre-processing and three-stage regressions.
result Improved forecasting accuracy and reduced uncertainty.
Boosting algorithms improve delivery time prediction in postal services.
problem Challenges in long-term travel time prediction for postal services.
method Investigated linear regression models, tree-based ensembles (random forest, bagging, boosting), and compared their performance.
result Boosting algorithms, especially light gradient boosting and catboost, outperform other methods in accuracy and runtime efficiency.
Generalizes conformal prediction to multiple learnable parameters for efficient prediction sets.
problem Learning valid and efficient prediction sets with low-capacity function classes.
method Constrained empirical risk minimization (ERM) with gradient-based optimization of differentiable surrogate losses and Lagrangians.
result Achieves approximate valid population coverage and near-optimal efficiency within class.
Unified comparison of gradient boosting algorithms for insurance claims.
problem Improving predictive accuracy and computational efficiency in insurance claim prediction.
method Unified notation and comprehensive numerical study comparing 12 gradient boosting algorithms on 5 datasets.
result No trade-off between model adequacy and predictive accuracy.
Paper analyzes time series prediction using empirical risk minimization.
problem Optimizing 1-step-ahead prediction for time series.
method Empirical risk minimization applied to recursive algorithms for time series forecasting.
result Empirical risk minimization achieves optimal predictive performance.
Study efficient algorithms for one-shot federated conformal prediction.
problem Valid prediction sets in one-shot federated learning.
method Quantile-of-quantiles family of estimators and split conformal prediction.
result No significant loss in coverage and length compared to centralized setting.
Quarter-hour market bursts predict algorithmic trading and returns in crypto futures.
problem Predicting returns in cryptocurrency futures markets using quarter-hour market bursts.
method Analysis of trade data and Autocorrelation Map to identify and quantify algorithmic trading activity.
result Quarter-hour market bursts are associated with algorithmic trading and can predict returns.
This paper evaluates how different imputation methods affect predictive models.
problem The impact of different imputation methods on predictive models' performance.
method Systematic evaluation of various imputation methods for different data sets and machine learning algorithms.
result Recommendation of a general method for empirical benchmarking of imputation methods.
New bounds estimate learning algorithm performance using prediction information.
problem Estimating the performance of black-box learning algorithms.
method Information-theoretic bounds based on prediction information.
result Improved bounds applicable to deterministic algorithms and easier to estimate.
In this paper, prediction for linear systems with missing information is investigated. New methods are introduced to improve the Mean Squared Error (MSE) on the test set in comparison to state-of-the-art methods, through appropriate tuning of Bias-Variance trade-off. First, the use of proposed Soft Weighted Prediction …
We introduce 'mixed LICORS', an algorithm for learning nonlinear, high-dimensional dynamics from spatio-temporal data, suitable for both prediction and simulation. Mixed LICORS extends the recent LICORS algorithm (Goerg and Shalizi, 2012) from hard clustering of predictive distributions to a non-parametric, EM-like sof…
FastMuyGPs speeds up GP predictions for large datasets.
problem High cost of Gaussian process predictions for large data.
method Combines cross-validation, batching, nearest neighbors sparsification, and precomputation.
result Superior accuracy and competitive runtime compared to other methods.
In the era of big data, practical applications in various domains continually generate large-scale time-series data. Among them, some data show significant or potential periodicity characteristics, such as meteorological and financial data. It is critical to efficiently identify the potential periodic patterns from mas…