BayesBlend blends multiple models' predictions for better insurance loss predictions.
problem Improving insurance loss predictions by combining multiple models.
method Pseudo-Bayesian model averaging, stacking, and hierarchical stacking.
result BayesBlend provides a user-friendly way to blend model predictions and estimate weights.
A new method for averaging model predictions using minimum divergence.
problem Improving model averaging methods, especially in small samples.
method Minimum divergence framework for model weight calculation.
result Empirically outperforms standard model averaging methods.
Paper uses averaging from many particle filters to approximate posterior predictive distributions.
problem Approximating posterior predictive distributions efficiently and accurately.
method Particle swarm filter algorithm that averages many particle filter approximations.
result Law of large numbers and central limit theorem support the method's effectiveness.
Paper develops new conformal prediction methods for sum or average of unknown labels.
problem Uncertainty quantification in joint distributions of random variables.
method Introduces novel conformal prediction methods for sum or average of unknown labels.
result Validates the proposed method for sum or average of unknown labels under permutation invariant assumptions.
Nested model averaging improves high-dimensional linear regression performance.
problem High-dimensional linear regression with predictor ordering impact.
method Combining model averaging with regularized estimators on the solution path.
result Nested model averaging with lasso and SLOPE outperforms competing methods.
Paper predicts cryptocurrency bull and bear phases using Bitcoin's moving averages.
problem Determining cryptocurrency bull and bear phases based on Bitcoin performance.
method Employing predictive algorithms to forecast Bitcoin's 50 Day and 200 Day Moving Averages.
result Predicted data from Bitcoin's moving averages helps identify potential bull and bear phases.
Predicting absolute magnitude of fluctuations of price, even if their sign remains unknown, is important for risk analysis and for option prices. In the present work, we display our predictions about absolute magnitude of daily fluctuations of the Dow Jones Industrials Average (DJIA), utilizing the original theory of c…
The paper extends a prediction method to curved spaces.
problem Prediction with expert advice in curved spaces.
method Geometric considerations and adaptation of online to batch conversion.
result Extension of exponentially weighted average forecaster to non-positive curvature spaces.
Bayesian framework mixes imperfect models for improved predictions.
problem Improving predictions of complex computational models in unknown domains.
method Local Bayesian Dirichlet mixing of imperfect models using the Dirichlet distribution.
result Global and local mixtures of models achieve excellent performance in prediction accuracy and uncertainty quantification.
We develop a method to predict the average of a binary sequence with bounded error.
problem Predicting the average of a binary sequence with selective prediction.
method Online prediction algorithm with adaptive window selection.
result Expected squared error of O(logn1) for predicting the average. Research predicts cryptocurrency staking rewards with high accuracy.
problem Predicting cryptocurrency staking rewards.
method Two predictive methodologies: sliding-window average and linear regression models.
result ETH staking rewards can be forecasted with RMSE within 0.7% and 1.1% of the mean value for 1-day and 7-day look-aheads respectively.
In this paper, we use the house price data ranging from January 2004 to October 2016 to predict the average house price of November and December in 2016 for each district in Beijing, Shanghai, Guangzhou and Shenzhen. We apply Autoregressive Integrated Moving Average model to generate the baseline while LSTM networks to…
Deep CNN model predicts stock prices with high accuracy.
problem Predicting stock prices due to volatility and multiple influencing factors.
method Deep CNN model trained on candle charts and continuous stock information.
result The method achieves 92.2% accuracy in predicting US NDAQ stock trends for 20 days.
BBCI uses meta prediction to estimate causal effects from datasets.
problem Estimating causal effects from observed data.
method Meta prediction to learn causal effect estimation.
result BBCI accurately estimates ATEs and CATEs across various causal inference problems.
The paper introduces moment multicalibration for estimating uncertainty across subgroups.
problem Ensuring fairness and accurate uncertainty estimation in predictions across different subgroups.
method Develops a method for multicalibration of higher moments, enabling point predictions and interval estimation.
result Moment multicalibration allows for valid prediction intervals that are fair across various subgroups.
SQR Averaging improves probabilistic electricity price forecasting.
problem Accurate short-term price forecasting in electricity markets.
method Smoothing Quantile Regression Averaging.
result SQR Averaging leads to profit increases of up to 3.5% in day-ahead power trading.
Group averaging boosts model accuracy without training cost.
problem Challenging training of equivariant models in physics.
method Group averaging at test time, improving accuracy.
result Improves model accuracy by up to 37% in continuous dynamics.
Improved traffic flow prediction model using Kalman filter noise reduction.
problem Low accuracy in predicting traffic flow parameters due to limited connected vehicle data.
method Combined LSTM with Kalman filter-based RTS noise reduction.
result Reduced prediction errors by 50-70% for speed and space headway.
Paper proposes dense average network for improved power load forecasting.
problem Improving power load forecasting accuracy to save millions for the power industry.
method Introduces dense average connection and constructs dense average network for power load forecasting.
result Proposed model outperforms existing methods on public datasets.
LASSO-PCA combines LASSO and PCA for automated forecast averaging.
problem Automating the selection of forecast averaging methods and tuning parameters.
method LASSO estimation combined with PCA, using information criteria for parameter selection.
result LASSO-PCA outperforms other methods in forecast error reduction.
Learn conditional averages in PAC framework for better predictions.
problem Learning average labels over neighborhoods in unknown concept class.
method Characterization of learnability using combinatorial parameters.
result Complete characterization and sample complexity bounds.
New analysis shows halting time is predictable for large models, improving optimization efficiency.
problem Understanding the average-case complexity of optimization algorithms for large-scale models.
method Average-case analysis of first-order methods on random least squares and neural networks.
result Halting time is independent of input distribution, leading to tighter convergence rates.
Study improves traffic prediction intervals for minor roads.
problem Uncertainty in traffic data for underrepresented minor roads.
method Quantile Random Forest with PCA for interval prediction.
result Achieved 88.22% interval coverage and Winkler Score of 7,468.47.
IA-BMA adapts model weights to inputs for better predictions.
problem Predicting with multiple models in heterogeneous settings.
method Input adaptive Bayesian Model Averaging (IA-BMA) with an input adaptive prior and amortized variational inference.
result IA-BMA consistently delivers more accurate and better-calibrated predictions.
Paper proposes an online adaptation algorithm for improving model performance.
problem Improving model fidelity in real-time for domain shift and time variance.
method Extended Kalman Filter with Exponential Moving Average and Dynamic Multi-Epoch strategy.
result Proposed algorithm outperforms existing methods in experiments.
The study examines how averaging data improves model performance.
problem Understanding the generalization gap in machine learning models.
method Data averaging, covariance analysis, and stochastic gradient descent (SGD) noise modeling.
result A modified generalization gap is always non-negative for a large class of model parameter distributions.
FP-BMA improves generalization by encouraging flat posteriors in Bayesian Model Averaging.
problem Lack of flat posterior in approximate Bayesian inference methods hinders effective Bayesian Model Averaging.
method Proposes Flat Posterior-aware Bayesian Model Averaging (FP-BMA) and Flat Posterior-aware Bayesian Transfer Learning schemes.
result FP-BMA successfully captures flat posteriors, improving generalization performance.
In evaluating prediction markets (and other crowd-prediction mechanisms), investigators have repeatedly observed a so-called "wisdom of crowds" effect, which roughly says that the average of participants performs much better than the average participant. The market price---an average or at least aggregate of traders' b…
We investigate the predictability of several range-based stock volatility estimators, and compare them to the standard close-to-close estimator which is most commonly acknowledged as the volatility. The patterns of volatility changes are analyzed using LSTM recurrent neural networks, which are a state of the art method…
A framework for multilayer networks predicts links without shared structures.
problem Link prediction in multilayer networks without shared structures.
method Bi-level model averaging with K-fold cross-validation. result Framework outperforms existing methods in predictive accuracy and robustness.
New approach shapes error distribution in long-term forecasting.
problem Disparate error distributions in recent transformer models.
method Loss shaping constraints to respect upper bounds on loss at each time-step.
result Competitive average performance with shaped error distribution.
New analysis shows Bayesian model averaging is suboptimal under misspecification.
problem Generalization performance of Bayesian model averaging under model misspecification.
method Novel second-order PAC-Bayes bounds to analyze generalization performance.
result New Bayesian-like algorithms with better generalization performance.
The study measures feature importance in models by randomly ablating features and averaging loss changes.
problem Measuring feature importance in machine learning models.
method Randomly ablating features and averaging loss changes over many points and replacements.
result Uncertainty measures of feature importance are presented.
Paper presents a method to reduce prediction variance of DNNs for unknown systems.
problem Uncertainty in DNN predictions due to high variance.
method Ensemble averaging of multiple DNN models trained independently.
result Reduction in variance of DNN predictions, improving reliability.
Revises Bayesian model averaging for foundation models.
problem Ensemble pre-trained and lightly-finetuned foundation models for improved classification performance.
method Introduces trainable linear classifiers and computationally cheaper model averaging scheme (OMA).
result Ensembled models can better predict on various datasets.
Bayesian stacking improves model performance with varying model weights.
problem Improving model predictions with heterogeneous input performance.
method Bayesian hierarchical stacking with varying model weights inferred via Bayesian inference.
result Hierarchical stacking yields better predictions than linear averaging.
This paper studies robust estimation methods in high dimensions, comparing model-averaged and composite quantile estimators.
problem Understanding robustness in high-dimensional regularized estimation.
method Optimal weights are determined by minimizing the asymptotic mean squared error, incorporating regularization effects without perfect selection.
result Model-averaged and composite quantile estimators often outperform least-squares methods in prediction quality.
Fed-ensemble improves FL by averaging predictions from multiple models.
problem Improving generalization in federated learning.
method Random permutations to update K models, averaging predictions.
result Predictions from all K models have the same predictive posterior distribution.
In this study, we present a multi-class graphical Bayesian predictive classifier that incorporates the uncertainty in the model selection into the standard Bayesian formalism. For each class, the dependence structure underlying the observed features is represented by a set of decomposable Gaussian graphical models. Emp…
New method uses label-weighted conformal prediction for macro-coverage guarantees in classification.
problem Finding a balance between class-conditional and marginal coverage in long-tailed datasets.
method Label-weighted conformal prediction for macro-coverage guarantees.
result Validated prediction sets with macro-coverage guarantees on large-scale image datasets.
Improved measure of predictive uncertainty for machine learning models.
problem Current measure of predictive uncertainty assumes BMA predictive distribution is equivalent to true model's distribution.
method Introduced a new measure based on information theory to correct the assumption.
result Our measure behaves more reasonably in synthetic tasks and is advantageous in real-world applications.
Study the averaging estimator on graphs with labeled nodes.
problem Understanding the quality of averaging estimators on graph data.
method Rigorously study concentration properties, variance bounds, and risk bounds.
result Contributes to theoretical understanding of graph learning.
The private car license plates issued in Shanghai are bestowed the title of "the most expensive sheet iron all over the world", more expensive than gold. A citizen has to bid in an monthly auction to obtain a license plate for his new private car. We perform statistical analysis to investigate the influence of the mini…
Stochastic gradient methods enable learning probabilistic models from large amounts of data. While large step-sizes (learning rates) have shown to be best for least-squares (e.g., Gaussian noise) once combined with parameter averaging, these are not leading to convergent algorithms in general. In this paper, we conside…
Transformations of macroeconomic data affect machine learning forecasts, especially with regularization and nonlinearity.
problem The impact of data transformations on machine learning forecasts in macroeconomic contexts.
method Review and propose new data transformations, empirically evaluate their effects, and compare traditional and moving average rotations.
result Traditional factors should almost always be included as predictors, and moving average rotations can provide important gains.
Paper introduces stability in model averaging and proposes a L2-penalty method.
problem Theoretical properties of model averaging from stability perspective.
method Introduces stability, defines asymptotic empirical risk minimizer, and proposes L2-penalty model averaging method.
result Proposed L2-penalty method ensures stability and consistency under reasonable conditions.
Paper assesses error estimates of Random Forests classification.
problem Quantitative assessment of Random Forests error estimates.
method Theoretical and empirical investigation of various error estimation methods.
result Random Forests' error estimates are closer to true error rate than average prediction error.
Kernel-based function approximation improves reinforcement learning performance.
problem Average reward reinforcement learning in infinite horizon settings.
method Optimistic algorithm based on kernel ridge regression.
result No-regret performance guarantees and confidence intervals for kernel-based predictions.