Quantum machine learning uses superposition to create a large ensemble of classifiers.
problem Improving machine learning efficiency on quantum computers.
method Using superposition to create an exponentially large ensemble of classifiers, trained with an optimization-free learning algorithm.
result Adding an optimization step improves the performance of quantum ensembles of classifiers.
Logifold improves ensemble machine learning by identifying fuzzy domains.
problem Improving ensemble machine learning accuracy.
method Formulating logifold structure and interpreting local charts of datasets.
result Logifold improves accuracy compared to averaging model outputs.
This paper proves long-time accuracy of ensemble Kalman filters for chaotic and machine-learned systems.
problem Ensuring long-term accuracy of ensemble Kalman filters for complex dynamical systems.
method Established conditions for long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systems.
result Ensemble Kalman filters maintain small estimation error over long time horizons for chaotic and machine-learned systems.
Paper proves global convergence of NCELM model.
problem Ensuring global convergence of NCELM model.
method Two-stage process: random base learners and NCL penalty term updates.
result Global convergence of NCELM proved using Banach theorem.
AD-EnKFs use machine learning to improve data assimilation in high-dimensional systems.
problem Data assimilation in high-dimensional, unknown dynamics systems.
method Auto-differentiable ensemble Kalman filters blending machine learning and ensemble Kalman filters.
result AD-EnKFs outperform existing methods in the Lorenz-96 model.
Paper analyzes uncertainty metrics in ensemble learning for healthcare AI.
problem Selecting appropriate uncertainty metrics for ensemble learners in healthcare AI.
method Rigorous analysis of two uncertainty metrics: ensemble mean and variance.
result Ensemble mean is preferable to ensemble variance for decision making in healthcare AI.
Improved wind speed forecasts for power generation using machine learning.
problem Improving the accuracy and reliability of wind speed predictions for power generation.
method A novel machine learning approach for calibrating wind speed ensemble forecasts.
result The proposed method improves the calibration and accuracy of probabilistic and point forecasts.
New metrics improve quantum ensemble learning efficiency and power.
problem Quantum ensembles' distances poorly understood due to measurement constraints.
method Introduce MMD-k hierarchy of integral probability metrics for quantum ensembles. result MMD-k requires fewer samples for full discriminative power at higher k. EnsembleSVM is a free software package containing efficient routines to perform ensemble learning with support vector machine (SVM) base models. It currently offers ensemble methods based on binary SVM models. Our implementation avoids duplicate storage and evaluation of support vectors which are shared between constit…
Study compares machine learning methods for improving wind gust forecasts.
problem Improving accuracy of wind gust forecasts from ensemble models.
method Comprehensive comparison of 8 statistical and machine learning methods.
result Locally adaptive neural networks significantly outperform other methods.
New ensemble SVM model reduces prediction error without choosing best kernel.
problem Reducing prediction error in regression problems.
method Bagged-weighted support vector regression model with random machines.
result Regression Random Machines achieve lower generalization error.
A new method creates simpler, more interpretable decision trees from complex ensembles.
problem Complex tree ensembles reduce interpretability and control over machine learning models.
method Dynamic-programming based algorithm for finding a minimum-size decision tree.
result Optimal born-again trees are simpler and more interpretable than original ensembles.
Ensemble learning improves anomaly detection for milder symptoms.
problem Difficulty in detecting incipient anomalies due to similarity to normal conditions.
method Utilize uncertainty information from ensemble learning to identify misclassified incipient anomalies.
result Ensemble learning methods show improved performance on incipient anomaly detection.
Survey of machine learning methods for time series forecasting.
problem Improving accuracy of time series predictions.
method Linear and nonlinear machine learning models, including neural networks and ensemble methods.
result Demonstrates superior predictive ability of certain machine learning models.
A new machine learning framework called machine collaboration improves prediction accuracy.
problem Improving prediction accuracy in machine learning.
method Machine Collaboration (MaC) framework, which uses a circular and interactive learning approach.
result Machine Collaboration framework significantly outperforms other state-of-the-art methods in most cases.
Machine learning improves cloud cover forecasting.
problem Improving accuracy of total cloud cover predictions.
method Investigated multilayer perceptron, gradient boosting machines, random forest, logistic regression models.
result RF models provide the smallest increase in predictive performance, while MLP, POLR, and GBM approaches perform best.
The paper analyzes bootstrap ensemble classifiers in high-dimensional settings.
problem Performance of bootstrap ensemble classifiers in high-dimensional data.
method Random Matrix Theory applied to LSSVM ensemble.
result Strategies to optimize performance of LSSVM ensemble.
Temporal mixture ensemble predicts cryptocurrency exchange volumes better than traditional methods.
problem Intraday volume forecasting in cryptocurrency markets.
method Temporal mixture ensemble model using transaction and order book data.
result The model outperforms traditional time series and machine learning methods.
The paper explores how prior functions and bootstrapping improve ensemble uncertainty estimation.
problem Improving uncertainty estimation in machine learning models.
method Investigates the benefits of prior functions and bootstrapping in ensemble models.
result Prior functions and bootstrapping enhance ensemble agents' uncertainty estimation across different inputs.
Jointly tuning ensemble models improves performance and uncertainty calibration.
problem Improving both predictive performance and uncertainty calibration in deep ensembles.
method Investigated the impact of jointly tuning weight decay, temperature scaling, and early stopping.
result Jointly tuning ensemble models generally matches or improves performance, with significant variation across tasks.
This study shows how social insects and machine learning methods share a common mathematical framework.
problem Understanding how decentralized systems achieve optimal decision-making.
method Developed a rigorous mathematical framework to show isomorphism between ant colonies and ensemble machine learning.
result Demonstrated that ant colony decision-making and random forest learning implement identical variance reduction strategies through decorrelation of identical units.
AGM improves model accuracy through adaptive generation and feature augmentation.
problem Improving model accuracy in machine learning competitions.
method Adaptive Generation Model (AGM) using stacked ensemble learning with horizontal and vertical model expansion and feature augmentation.
result AGM outperforms previous models in 7 data sets.
Paper combines multiple ETA models into a stacked ensemble for better ETA predictions.
problem Improving ETA predictions for taxi schedules and trips.
method Developed a two-level stacked ensemble model and applied XAI methods to explain it.
result The stacked ensemble model outperforms previous ETA approaches.
Study improves drug synergy prediction using ensemble learning.
problem Predicting drug synergy in complex diseases.
method Investigated different compound representations and proposed an ensemble model.
result Ensemble model outperforms baseline models.
Paper presents a machine learning framework for corn yield forecasting.
problem Accurate and timely prediction of corn yields in the US Corn Belt.
method Machine learning ensembles considering complete and partial in-season weather data.
result Ensemble models outperform individual models, achieving best prediction accuracy.
Enhanced ensemble filters use machine learning to improve accuracy in filtering models.
problem Accuracy limitations of traditional ensemble Kalman filters.
method Introduces a measure neural mapping (MNM) to map joint predicted state and observation to updated state estimates.
result Superior root-mean-square-error performance compared to leading methods in filtering models.
Study reviews tree-based methods and introduces new ensemble strategies.
problem Improving the efficiency and performance of tree-based machine learning models.
method Review of tree-based methods, introduction of ISLE framework, ARM model combination strategy, and modified ISLEs.
result Performance evaluation of modified ISLEs on real data sets.
Improved anomaly detection for incipient faults using ensemble learning.
problem Difficulty in detecting milder anomalies due to similarity to normal conditions.
method Utilize uncertainty information from ensemble learning to identify misclassified incipient anomalies.
result Ensemble learning improves performance on incipient anomaly detection.
Self-paced ensemble learning improves audio classification models.
problem Improving performance of individual models in speech and audio classification.
method A self-paced ensemble learning scheme where models learn from each other over several iterations.
result SPEL significantly outperforms baseline ensemble models.
Ensemble methods for supervised machine learning have become popular due to their ability to accurately predict class labels with groups of simple, lightweight "base learners." While ensembles offer computationally efficient models that have good predictive capability they tend to be large and offer little insight into…
UNREAL selectively ensembles distinct models to improve active learning performance.
problem Difficulty in distinguishing genuine uncertainty from noise in limited labeled data.
method Selective ensembling of distinct models from the Rashomon set.
result UNREAL achieves faster convergence and up to 20% predictive accuracy improvement.
Gradient-free ensemble learns sector forecasts from diverse models.
problem Predicting sector returns in a volatile market.
method Dynamic model combination using out-of-sample R-squared.
result Ensemble outperforms individual models in sector rotation.
Shallow trees in ensemble models make models more interpretable and sometimes better.
problem Lack of transparency in high-performing tree ensemble models.
method Developed an interpretation algorithm to convert tree ensembles into functional ANOVA representations. Proposed strategies to enhance interpretability.
result Shallow trees in ensemble models can lead to better generalization performance and improved interpretability.
This study compares multivariate vs univariate machine learning for multi-output regression.
problem When to use multivariate ensemble techniques over separate univariate models.
method Comparative analysis of different multivariate approaches for multi-output regression.
result Multivariate ensemble techniques outperform separate univariate models in simulations.
E3 combines sparse MoEs and ensembles to improve model efficiency and performance.
problem Improving model efficiency and performance in machine learning.
method Combining sparse mixture of experts and ensembles, presenting Efficient Ensemble of Experts (E3). result E3 achieves better accuracy, log-likelihood, few-shot learning, robustness, and uncertainty estimates than baselines. GPR ensemble method predicts stock returns efficiently.
problem Predicting stock returns using machine learning.
method Ensemble Gaussian Process Regression (GPR) for online learning.
result Method outperforms existing models in R-squared and Sharpe ratio. Research proposes an ensemble learning model for efficient software defect prediction.
problem Efficient and cost-effective software testing to minimize project resources.
method Machine learning analysis on different datasets using KNN, Decision Tree, SVM, and Naïve Bayes.
result Ensemble learning model outperforms other techniques in accuracy, precision, recall, and F1-score.
Ensemble models struggle with detecting mild faults.
problem Difficulty in detecting Intermediate-Severity faults due to their resemblance to normal conditions.
method Extensive experiments with ensemble models to identify and address common pitfalls.
result Designing more effective ensemble models for IS fault detection and diagnosis.
Reduces false positives in classifying rare online platforms.
problem Challenges in accurately identifying rare online platforms with ML.
method Calibrated probabilities and ensembles to reduce bias.
result Significantly reduces false positives in rare event detection.
Combines machine learning and data assimilation for improved forecasting.
problem Improving forecast accuracy with noisy observations.
method Sequentially learns a machine-learning model using an ensemble Kalman filter.
result The combined model achieves good forecast skill and computational efficiency.
A new ensemble learning method called Residual Likelihood Forests improves performance and reduces model size.
problem Improving machine learning classification performance with compact models.
method Sequential optimization of conditional likelihoods in a boosting-like framework, combining multiplicatively.
result Significant performance improvements and reduced model size compared to other ensemble methods.
Enhances fairness in predictions without sacrificing accuracy.
problem Balancing fairness and predictive performance in machine learning.
method Model ensemble-based post-processing framework.
result Framework effectively enhances fairness while maintaining predictive accuracy.
DSL uses supervised learning to optimize portfolios, improving stability and performance.
problem Optimizing robust portfolios in financial markets.
method DSL reframes portfolio construction as a supervised learning problem, using cross-entropy loss and optimizing Sharpe or Sortino ratios. Deep Ensemble methods are employed to reduce variance.
result DSL outperforms traditional and machine learning methods, achieving higher median returns and more stable risk-adjusted performance.
Combining feature importance estimates improves reliability of machine learning predictions.
problem Lack of consensus on feature importance quantification makes explanations unreliable.
method Proposes a feature importance fusion framework combining multiple quantifiers.
result Feature importance ensembles reduce prediction error by 15%.
Paper uses ensemble learning for IoT cybersecurity anomaly detection.
problem Anomaly detection in IoT data is challenging due to heterogeneous device types.
method Bayesian hyperparameter optimisation for ensemble learning.
result Ensemble learning with Bayesian optimisation improves anomaly detection accuracy.
The standard probabilistic perspective on machine learning gives rise to empirical risk-minimization tasks that are frequently solved by stochastic gradient descent (SGD) and variants thereof. We present a formulation of these tasks as classical inverse or filtering problems and, furthermore, we propose an efficient, g…
A new ensemble of Gaussian processes improves active learning efficiency.
problem Efficiently labeling data in high-cost domains like medical imaging.
method Adaptive weighted ensemble of Gaussian processes (EGP) for active learning.
result EGP-based approaches outperform single GP-based active learning methods.
Deep ensembles effectively capture epistemic uncertainty through training stochasticity, providing a frequentist perspective.
problem Understanding and quantifying epistemic uncertainty in machine learning models.
method Bootstrap-based estimator and decomposition of deep ensembles into data variability and training stochasticity.
result Deep ensembles primarily capture training stochasticity, explaining their effectiveness in quantifying epistemic uncertainty.