A dual-learner strategy tracks concept drift in nonstationary data streams.
problem Learning from nonstationary data with abrupt or gradual changes.
method Alternating learners framework with long- and short-memory models.
result Effective tracking and prediction of concept drift in streaming data.
New theory shows how learning algorithms can create a bias towards negative outcomes.
problem Negativity bias in adaptive learning algorithms.
method Generalization of the Hot Stove Effect to settings with negative estimates leading to smaller sample sizes.
result Negativity bias persists even when negative estimates do not lead to avoidance.
A new method improves super learner validation efficiency.
problem Improving the efficiency of super learner validation.
method Bootstrap Bias Corrected Cross Validation applied to Super Learning.
result Bootstrap Bias Corrected Cross Validation proved efficient and cost-effective.
sGBM speeds up gradient boosting by parallelizing and adapting base learners.
problem Infeasibility of parallelizing GBM training and sub-optimal performance in online settings.
method Integrates multiple differentiable base learners, jointly optimizing them with linear speed-up.
result sGBM achieves higher time efficiency and better accuracy than traditional GBM.
Stacked conformal prediction simplifies model validation.
problem Validating stacked predictive models efficiently.
method Meta-learner at the top of a stacked ensemble for approximate marginal validity.
result The method achieves approximate marginal validity without a separate calibration sample.
LIBRE learns interpretable Boolean rules from data.
problem Creating interpretable classifiers in imbalanced settings.
method Ensemble of weak learners on random feature subsets, combined with a simple union.
result Efficiently balances prediction accuracy and interpretability.
In reinforcement learning, agents learn by performing actions and observing their outcomes. Sometimes, it is desirable for a human operator to \textit{interrupt} an agent in order to prevent dangerous situations from happening. Yet, as part of their learning process, agents may link these interruptions, that impact the…
A learner selects subsets of choices for a user who then picks from them, aiming to minimize regret.
problem Optimizing subset selection for user choices in a stochastic setting.
method Introduces a new problem and defines regret, then proposes algorithms with matching upper and lower bounds.
result Upper and lower bounds on expected regret match up to a logarithmic term, demonstrating algorithm efficiency.
Meta-learner reduces few-shot learning errors by nulling out error signals.
problem Few-shot learning accuracy issues in neural networks.
method Linear transformer for null-space projection of neural network outputs.
result Meta-learner achieves best or near-best image classification accuracies.
Algorithm selects k arms from context-dependent options using Plackett-Luce model.
problem Selecting k arms from context-dependent options with Plackett-Luce feedback.
method Proposes CPPL algorithm inspired by UCB, evaluated on synthetic and real data.
result Demonstrates effectiveness of CPPL algorithm in online algorithm selection.
Causality-aware methods outperform linear residualization in confounding adjustment for anticausal prediction.
problem Adjusting for confounding in anticausal prediction tasks.
method Causality-aware counterfactual confounding adjustment.
result Causality-aware methods asymptotically outperform linear residualization in predictive performance.
End-to-end autonomous driving models get better uncertainty estimates.
problem Uncertainty quantification for end-to-end autonomous driving models.
method Approximate inference for implicit copula neural linear model.
result Densities for steering angle are marginally calibrated.
We consider sequential decision making problems for binary classification scenario in which the learner takes an active role in repeatedly selecting samples from the action pool and receives the binary label of the selected alternatives. Our problem is motivated by applications where observations are time consuming and…
A model for deciding which facts to remember in a lifelong learning scenario.
problem Deciding which facts to retain in limited memory from an endless stream of information.
method Mathematical model based on online learning framework, using multiplicative weights update algorithm with modifications.
result Design of an alternative scheme with close to optimal regret guarantees for memory-constrained lifelong learning.
Study shows algorithms benefit from limited target data with many source domains.
problem Adapting to new domains with scarce labeled target data.
method New family of model selection algorithms.
result Beneficial guarantees in scenarios with limited target data.
Machine learning improves learning and memory retention by optimizing study sessions.
problem Improving learning and memory retention methods for factual material.
method Large-scale randomized controlled trial with machine learning optimization of study sessions.
result Study sessions optimized with machine learning lead to 67% longer retention and 50% higher return rate.
Meta-learning approach improves generalizability of models for few-shot learning.
problem Overfitting of meta-learners on existing tasks limits their adaptability to new tasks.
method Task-Agnostic Meta-Learning (TAML) algorithms that prevent overfitting and learn unbiased initial models.
result TAML algorithms outperform existing meta-learning approaches in few-shot classification and reinforcement learning.
Faster SVM outperforms deep learning for text mining, 500x faster.
problem Slow training times of deep learning methods in text mining.
method Clustering dataset, tuning simpler learners within clusters.
result SVM approach is over 500 times faster with similar performance.
Paper combines machine learning and model averaging for robust parameter estimation.
problem Estimating structural parameters with partially unknown functional forms.
method Pairing double/debiased machine learning with stacking for model averaging.
result DDML with stacking is more robust to unknown functional forms than single learners.
LSTMs fail in financial tasks, CL improves performance.
problem Financial time-series analysis and inference with LSTMs.
method Continual Learning (CL) approach for financial decision making.
result CL outperforms LSTMs and FFNN in financial decision making.
A new method reduces communication in distributed RL without sacrificing performance.
problem High communication overhead in distributed RL systems.
method Adaptive policy gradient approach that skips communication during iterations.
result Reduces communication rounds needed for learning accuracy without degrading performance.
A new model VCM improves collaborative filtering by synchronously linking two VAEs.
problem Cold start and data sparsity issues in CF-based recommender systems.
method Proposes a variational collaborative model (VCM) that synchronously links two VAEs.
result VCM outperforms state-of-the-art methods on real-life datasets.
The paper estimates personalized treatment effects in medical settings with competing risks.
problem Estimating treatment effectiveness for specific events in the presence of alternative event types.
method Meta-learners combining Cox regression or random survival forests for risk modeling and elastic net regression or random forests for direct CATE modeling.
result Compared meta-learners in multiple simulation settings, providing practical guidance for model selection.
Improves deep neural networks using soft labels through alternating minimization.
problem Improving deep neural networks training with soft labels.
method Co-Learns DNNs and soft labels via Alternating Minimization of two objectives.
result COLAM achieves improved performance on many tasks with better testing classification accuracy.
Super learner with Huber loss improves cost prediction and causal effect estimation in healthcare expenditure data.
problem Challenges in modeling healthcare expenditure distributions with standard super learning methods.
method Proposes a super learner using Huber loss, a robust loss function that down-weights outliers.
result Demonstrates appreciable finite-sample gains in cost prediction and causal effect estimation.
HATT improves online decision tree ensembles by using a more eager splitting strategy.
problem Improving the efficiency of online decision tree ensembles.
method Replacing Hoeffding Tree's split strategy with HATT, which uses the Hoeffding Test for candidate splits.
result HATT outperforms Hoeffding Tree in online bagging and boosting ensembles, as shown by significant performance improvements in various testbenches.
Optimal algorithm converts weak to strong learner with less data.
problem Constructing a strong learner from a weak learner with minimal data.
method New algorithm that uses less training data than AdaBoost.
result Optimal sample complexity for converting weak to strong learner.
Paper improves teaching by considering learner's preferences and constraints.
problem Teaching without considering learner's preferences and constraints.
method Design of learner-aware teaching algorithms that account for learner's preferences and constraints.
result Significant performance improvements over learner-agnostic teaching.
The paper proposes a method to assess surrogate heterogeneity in non-randomized data.
problem Lack of methods to evaluate surrogate heterogeneity in non-randomized data.
method Proposes a framework using meta-learners to assess surrogate heterogeneity in real-world data.
result Identifies individuals for whom the surrogate is a valid replacement of the primary outcome.
Meta clustering categorizes learners for collaborative learning.
problem Filtering out unqualified collaborators in collaborative learning.
method Select-Exchange-Cluster (SEC) method to classify learners by their supervised functions.
result SEC can cluster learners into accurate collaboration sets and enhance single-learner performance.
New meta-learners estimate time-varying treatment effects without model assumptions.
problem Estimating treatment effects over time in personalized medicine.
method Model-agnostic meta-learners for weighted pseudo-outcome regressions.
result Comprehensive theoretical analysis and practical insights for choosing meta-learners.
Builds a novel educational recommender for lifelong learners.
problem Challenges in creating scalable and transparent models for lifelong learning.
method Integrative approach combining content novelty, background knowledge, and learner engagement.
result TrueLearn achieves promising performance while retaining a human interpretable learner model.
Wasserstein gradient boosting predicts probability distributions for supervised learning.
problem Distribution-valued supervised learning where outputs are probability distributions.
method Fits a new weak learner to Wasserstein gradients of loss functionals of probability distributions.
result Superior performance in probabilistic prediction compared to existing methods.
New survival learners estimate heterogeneous treatment effects from time-to-event data.
problem Estimating HTEs from time-to-event data with censoring outcomes.
method Orthogonal survival learners with theoretical guarantees and custom weighting functions.
result Orthogonal survival learners provide robust and model-agnostic HTE estimation.
Proposes a method to integrate learner models robustly against misspecifications.
problem Misspecifications in learner models and parameter sharing patterns degrade prediction accuracy.
method Sequentially incorporates additional learners based on user-specified parameter sharing patterns.
result Data-adaptively selects the most suitable way of parameter sharing to enhance predictive performance.
VTIRT speeds up IRT inference for dynamic learner proficiency.
problem Expensive and slow inference algorithms for dynamic IRT models.
method Variational Temporal IRT (VTIRT) for fast, accurate inference.
result Orders of magnitude speedup in inference runtime with accurate results.
Method selects the best deep learner for time-series prediction using Bayesian networks.
problem Selecting the most effective deep learning model for time-series prediction.
method Bayesian network selects deep learners based on input variables and cluster training data.
result Threshold value determines which deep learners predict time-series data robustly.
CERL uses a portfolio of learners to explore diverse regions, outperforming individual learners.
problem Limited exploration and sensitivity to hyperparameters in reinforcement learning.
method CERL employs a portfolio of learners with varying time-horizons and a shared replay buffer, dynamically distributing computational resources.
result Emergent learner outperforms individual learners and is more sample-efficient.
pystacked combines machine learning models for improved predictions.
problem Improving machine learning model performance through stacking.
method Stacked generalization using Python's scikit-learn with various base learners.
result Enhanced predictive models through combining multiple machine learning algorithms.
Teaches sequential learners with changing inner states to improve future performance.
problem Teaching sequential learners with evolving inner states.
method Introduces an optimal control approach for multi-agent learning.
result Optimal control approach improves future performance of learners.
MTL2L learns to adapt optimisation rules for unseen data.
problem Learners need to adapt to unseen data domains.
method Introduces MTL2L, a context-aware neural optimiser.
result MTL2L can adapt optimisation rules for unseen data.
Reward shaping speeds up human learning through IRL.
problem Slow learning in humans, especially for challenging tasks.
method Extended IRL algorithm with kernel methods, conducted experiments with online game players.
result Players learn desired policies more quickly with reward shaping.
Study multiple learners' robustness to adversarial attacks.
problem Adversaries can manipulate multiple learners' predictions.
method Approximate adversarial game, find unique equilibrium, and develop algorithm.
result Equilibrium models are more robust than regularized linear regression.
Theorem ensures superior learning outcomes for authorized learners with quantum label encoding.
problem Ensuring data security for authorized learners in machine learning.
method Quantum label encoding and PAC learning framework.
result Authorized learners achieve superior learning outcomes while eavesdroppers do not.
Improves learning efficiency for active sequential learners.
problem Optimizing training data for sequential learners who actively choose their queries.
method Formulated as a Markov decision process, addressing both teaching and learning from a teacher.
result Planning teaching and learner's model of the teacher improve learning outcomes.
Meta-learners improve causal effect estimation in small samples.
problem Estimating causal effects using machine learning methods.
method Sample-splitting and cross-fitting to reduce overfitting bias.
result Meta-learners' performance depends on sample size and estimation procedure.
Paper tackles black-box machine teaching with cross-space models, proposing an active teacher model.
problem Teaching a learner with different feature representations and without full observation.
method Proposes an active teacher model that queries the learner to estimate its status and guide faster convergence.
result Active teacher model achieves faster convergence rate than traditional passive learning.
Boosts causal discovery by dynamically reweighting samples to learn better DAGs.
problem Overfitting to easier-to-fit samples and violating homogeneity assumptions in causal discovery.
method Adaptive sample reweighting via ReScore function to upweight and downweight samples based on fitting quality.
result Consistent and significant boosts in structure learning performance on synthetic and real-world datasets.