Hierarchical MARL learns complementary skills for team coordination.
problem Creating intelligent agents that coordinate like human sports teams.
method Two-level hierarchical MARL with unsupervised skill discovery.
result Emergence of useful and complementary skills in team games.
Method learns diverse robot skills for complex tasks.
problem Simulation-to-real transfer for robot skills.
method Decomposes skills, learns parameterized embeddings, and composes them.
result Transferable high-level policies using low-level skills.
HiPPO adapts skills and higher-level policies together for better transfer in hierarchical RL.
problem Sub-optimality in skill transfer when lower-level skills are fixed.
method HiPPO: a novel hierarchical policy gradient method that trains all levels of the hierarchy jointly.
result Improved robustness of skills to environment changes through training time-abstractions.
SUPE combines unlabeled data with RL to efficiently explore tasks.
problem Efficient exploration in reinforcement learning with sparse rewards.
method Extract low-level skills using VAE, pseudo-label unlabeled data, and use as off-policy data for online RL.
result SUPE outperforms prior methods across 42 long-horizon tasks.
A planning approach learns skills from interactions, balancing exploration and exploitation.
problem Learning robust high-level skills in noisy environments with unknown pre-conditions.
method Formulates skills as high-level policies, learns plans via bandit problems, balances exploration and exploitation.
result A planner capable of learning robust high-level skills in high-dimensional state spaces.
Paper learns skill distributions from game outcomes, proving minimax optimality.
problem Learning skill distributions from noisy pairwise game outcomes.
method Proposes a simple algorithm using kernel density estimation and minimax techniques.
result Near-optimal minimax mean squared error scaling for skill density estimation.
The paper analyzes spatio-temporal behavior in DotA 2, finding skill differences in team dynamics.
problem Understanding skill differences in MOBA team dynamics.
method Data-driven measures of spatio-temporal behavior, including zone changes and time series clustering.
result Professional teams show smaller within-team distances and more zone changes than amateur teams.
Optimal learning paths designed for E-learning systems using reinforcement learning.
problem Designing optimal learning paths for E-learning systems.
method Developed a hierarchical skill model and a proficiency level model, applied reinforcement learning to find the optimal learning strategy.
result Demonstrated the effectiveness of the proposed framework via numerical experiments.
Paper learns versatile balancing and recovery motions for humanoid robots.
problem Training humanoid robots to handle unexpected perturbations.
method Hierarchical Deep Reinforcement Learning in a physics simulator.
result Learned skills comparable to preprogrammed controllers but more adaptable.
Bayesian nonparametrics enables dynamic skill discovery from expert data.
problem Fixed K for offline skill discovery in reinforcement learning.
method Variational inference, continuous relaxations, Bayesian nonparametrics.
result Nonparametric model with dynamically-changing number of options.
The paper analyzes how employers can efficiently screen candidates using multiple tests, considering both skill estimation and fairness.
problem How to efficiently screen candidates using multiple noisy signals without violating fairness.
method The paper extends traditional screening models to a multi-test setting, analyzing optimal employer policies for both fixed and dynamic test assignments.
result A fundamental impossibility emerges when noise levels vary across groups, making it impossible to administer the same number of tests and maintain the same outcomes.
Investor skill levels affect optimal portfolio size, study shows.
problem Optimal portfolio size for different skill levels of investors.
method Mathematical methods to study annual and continuous portfolio diversification, regression analysis.
result Strong investors should hold concentrated portfolios, poor investors should hold diversified portfolios.
The paper explains how language models acquire complex skills through scaling laws and statistical analysis.
problem Understanding how language models acquire new skills as their size and training data increase.
method Statistical framework and mathematical analysis of scaling laws.
result Language models can learn complex skills efficiently due to a strong inductive bias.
The study examines how to assess skill when outcomes are noisy and insufficient.
problem Determining skill when outcomes are unreliable and insufficiently numerous.
method Characterizes decision domains with noise and effective sample size, using population-level validation methods.
result Domains with noisy outcomes are unreliable for individual skill assessment.
The paper examines skill estimation and variance under model misspecification in IRT.
problem Underestimation and overestimation of skills when non-compensatory model is misspecified as compensatory.
method Theoretical approach to analyze underestimation and overestimation of skills and variance.
result Overestimation of skills occurs around the origin and asymptotic variance differs under model misspecification.
Machine learning identifies skill levels in neurosurgery residents.
problem Assessing neurosurgical skill levels in residents.
method Machine learning applied to a VR tumor resection task with 23 skilled and 92 novice participants.
result Fuzzy K-Nearest Neighbors classifier achieved 8.3% equal error rate with 15 selected features.
Researchers study how skills are learned in neural networks using physics principles.
problem Understanding how skills are sequentially learned in neural networks.
method Abstract and simplify the problem using physics principles, proposing three models: Geometry, Resource, and Domino.
result Models reveal insights into neural scaling laws, learning dynamics, and the benefits of modularity.
The paper presents a method for personalized exercise recommendations that improves learner skill gain.
problem Adapting to individual needs in large, diverse groups of learners in digital environments.
method Contextual Thompson Sampling to select exercises that advance learner skill.
result The method recommends exercises associated with greater skill improvement and adapts to learner differences.
A new method for solving complex sequential decision-making problems by decomposing them into multiple levels.
problem Sequential decision-making with natural multi-level structure.
method Multi-level meta-reinforcement learning with skill-based curriculum.
result Efficiently reduces stochasticity and policy search space, leading to fewer iterations and computations.
Machine learning assesses surgical skill in robotic-assisted surgery.
problem Subjective evaluation of surgeon skill in robotic-assisted surgery.
method Machine learning applied to six movement features for classification.
result Framework classifies surgical skill with 85.7% accuracy.
Tests Sharpe ratio for skill vs luck in asset management.
problem Accuracy of Sharpe ratio in measuring skill vs luck.
method Statistical tests to assess the significance of Sharpe ratios.
result Tests reveal the statistical significance of Sharpe ratios and their impact of auto-correlation.
Three methods detect informed trading on prediction markets, each focusing on different aspects.
problem Detecting informed trading in decentralized prediction markets.
method Composite screen, event-level sign-randomization test, and Information Leakage Score (ILS) framework.
result Different methods detect informed trading on prediction markets, each focusing on different aspects.
Study compares employers with and without anticipating strategic labor force responses.
problem Understanding and optimizing strategic interactions in labor markets.
method Formulation of causal strategic classification, theory, and experiments.
result Performatively optimal hiring policies improve employer and labor outcomes, but can also harm labor force utility.
The paper learns robot skills from demonstrations without supervision.
problem Discovering robotic options from unlabelled demonstrations.
method Temporal variational inference for latent variable learning.
result The framework can learn options across multiple datasets.
New method learns robot skills from data, matching or outperforming existing methods.
problem Learning robot skills from fixed datasets.
method Offline Reinforcement Learning via Supervised Learning using implicit models.
result Implicit models can match or outperform explicit models in acquiring robotic skills.
New method automates asymmetric choice for better skill transfer in reinforcement learning.
problem Improving sample efficiency and transferability of reinforcement learning agents.
method Attentive Priors for Expressive and Transferable Skills (APES) using hierarchical KL-regularization.
result APES automates asymmetric choice, leading to better skill transfer across sequential tasks.
Language helps RL agents learn complex tasks by composing sub-skills.
problem Solving complex, temporally-extended tasks in RL.
method Using language as an abstraction to learn and reuse sub-skills.
result Agents can learn and solve diverse, temporally-extended tasks.
Bayesian model identifies skill difficulties and student subgroups in engineering education.
problem Identifying and supporting diverse student needs in entry-level university engineering modules.
method Hierarchical Bayesian modeling of student response data.
result Clear patterns of skill mastery and distinct student subgroups identified.
MOVDA improves skill ratings by considering margin of victory deviations.
problem Traditional rating systems discard valuable performance data.
method Margin of Victory Differential Analysis (MOVDA) learns a non-linear function to predict expected MOV and uses the difference between true and expected MOV for rating updates.
result MOVDA significantly outperforms standard ELO and Bayesian baselines in NBA basketball data.
The paper proposes a method for a robot to learn skills from imagined goals.
problem Training robots to perform a wide range of tasks with raw sensory input.
method Combining unsupervised representation learning and reinforcement learning of goal-conditioned policies.
result The method learns skills that can operate on raw image observations and outperforms prior techniques.
ReSkill reconciles RL skill creation with policy optimization.
problem RL policies lack reusable strategies across tasks.
method Integrates skill creation into RL loop with three mechanisms.
result Consistently outperforms existing methods, especially on unseen tasks.
Paper proposes a method to accurately match soft skills in job ads.
problem Matching soft skills in job ads leads to false positives.
method Phrase-matching approach with context-based binary classification.
result LSTM tagging-based input representation achieved highest recall of 83.92%.
VarFA efficiently estimates student skill levels with uncertainty for adaptive testing.
problem Efficiently estimating student skill levels with uncertainty for adaptive testing.
method VarFA uses variational inference to extend factor analysis models for educational data.
result VarFA efficiently handles large datasets and produces uncertainty estimates.
The paper proposes a method to transfer skills between tasks using disentangled latent policies.
problem Transfer learning in reinforcement learning struggles with diverse tasks without explicit supervision.
method Learning a small set of policies in a disentangled latent space that can be recombined to solve many tasks.
result Disentangled latent policies enable quick performance on many diverse tasks.
A model corrects Lithuanian grammatical errors.
problem Lack of language skills and typing errors in Lithuanian.
method Transformer architectures for subword and byte-level approaches.
result F0.5=0.92 for Lithuanian grammatical error correction. ASAP learns skills and where to apply them for general task solving.
problem General task solving in complex environments.
method Adaptive Skills, Adaptive Partitions (ASAP) framework.
result ASAP converges to a local optimum under natural conditions and learns where to reuse skills.
Robotics learns new skills faster by reusing past movements.
problem Learning new motor skills is time-consuming and requires exploration of a large space of motor configurations.
method Combines probabilistic movement primitives with relative entropy policy search for skill initialization and adaptation.
result Quality of learned skills improves and the number of required iterations to learn a new task can be reduced by more than 60%.
Progressive reinforcement learning combines expert policies for multi-skilled motion control.
problem Integrating policies for multiple skills in continuous control problems.
method Policy distillation, input injection, transfer learning.
result Incremental policy augmentation with new skills.
MCP learns reusable skills for complex tasks by combining simple ones.
problem Learning complex tasks with many skills requires impractical amounts of data.
method Factorizes skills into primitives that can be combined multiplicatively.
result MCP can learn and reuse skills for novel tasks from pre-training.
DAS3H optimizes skill-based spaced repetition schedules.
problem Optimizing adaptive and personalized spaced repetition schedules for skill-based learning.
method Developed a new student learning and forgetting model (DAS3H) that considers memory decay and multiple skills.
result DAS3H outperforms other models on real-world educational datasets.
Convolutional neural networks improve surgical skill evaluation.
problem Manual feedback from senior surgeons is laborious, expensive, and subjective.
method Fully convolutional neural networks (CNNs) for classifying and regressing surgical skills.
result Deep neural networks achieve competitive performance on JIGSAWS dataset.
A simple method to prevent forgetting in neural networks.
problem Catastrophic forgetting in neural networks.
method Weight friction, inspired by neurology and physics, modifies the gradient descent update rule.
result Weight friction enables continual learning with comparable performance and efficiency.
ABC method improves subseasonal weather forecasting by 60-90%.
problem Improving subseasonal temperature and precipitation forecasting accuracy.
method Combines dynamical forecasts with machine learning-based bias correction.
result Significant improvement in temperature and precipitation forecasting skills.
Paper proposes a method to compose task-agnostic skills for solving new problems.
problem Learning task-specific policies for solving new problems.
method Deep reinforcement learning-based skill transfer and composition method.
result Method transfers skills to new problem settings and solves challenging environments with high data efficiency.
Gradient descent solves sparse skill estimation in crowdsourcing.
problem Crowd-sourced worker skill estimation with sparse and irregular assignments.
method Rank-one matrix completion and projected gradient descent.
result Skill estimates converge to global optima for specific sampling matrices.
DSE learns transferable skills across changing dynamics and goals.
problem Learning transferable skills across different reinforcement learning tasks.
method Variational inference for multi-task reinforcement learning with shared and task-specific latent spaces.
result Policies can generalize to unseen dynamics and goals conditions.
Robot learns from multiple teachers to efficiently achieve various motor skill outcomes.
problem Efficiently learning motor skills from multiple teachers and strategies.
method Hierarchical active decisions based on empirical evaluation of learning progress.
result Significantly more efficient learning and coherent strategy selection.
DADS discovers skills with predictable outcomes from unlabeled data.
problem Learning accurate models for complex dynamical systems is difficult and often doesn't generalize well.
method Dynamics-Aware Discovery of Skills (DADS) combines model-based and model-free learning.
result DADS discovers infinitely many behaviors in high-dimensional state-spaces.