Robot learns sensorimotor relationships through exploration.
problem Autonomous acquisition of sensorimotor contingencies by robots.
method Developmental framework encoding predictive models of sensorimotor experience.
result Robot discovers the environment, objects, and visual field through internal encoding of sensorimotor contingencies.
Robots learn actions and language through curiosity-driven self-exploration.
problem Efficient development of actions and language in infants and robots.
method Curiosity-driven self-exploration using Q-learning to amortize active inference.
result Curiosity-driven exploration enables faster learning and compositional generalization.
New method allows a robot to perceive space dimensions without prior knowledge.
problem Limitation of previous methods in perceiving space dimensions with small movements.
method Non-linear dimension estimation method.
result Robots can now perceive space dimensions with larger movements.
This work tackles autonomous learning of interrelated tasks in robots.
problem Learning interrelated tasks in robots, especially in complex environments.
method Using a multi-task reinforcement learning approach within an MDP framework.
result Demonstrates how to autonomously learn interrelated tasks in robots.
One of the open challenges in designing robots that operate successfully in the unpredictable human environment is how to make them able to predict what actions they can perform on objects, and what their effects will be, i.e., the ability to perceive object affordances. Since modeling all the possible world interactio…
Bayesian Neural Networks show similar developmental stages as human learning.
problem Comparing human and machine learning stages.
method Operationalized developmental stages as data-set size, analyzed on three tasks.
result Bayesian Neural Networks exhibit similar developmental patterns to human learning.
Preschool attendance correlates with lower developmental vulnerabilities in Queensland, Australia.
problem Understanding the relationship between preschool attendance and developmental vulnerabilities in different regions.
method Data Analysis and Machine Learning to identify clusters of socio-demographic variables.
result Identified three clusters with varying socio-demographic variables affecting the relationship between preschool attendance and developmental vulnerabilities.
Infants with a variety of complications at or before birth are classified as being at risk for developmental delays (AR). As they grow older, they are followed by healthcare providers in an effort to discern whether they are on a typical or impaired developmental trajectory. Often, it is difficult to make an accurate d…
2D tissue model predicts neurotoxicity more accurately and robustly.
problem Fast and accurate prediction of developmental neurotoxicity.
method Machine learning on 2D bio-engineered tissue models.
result 2D model outperforms 3D model in accuracy and robustness.
A new framework ensures model safety by retaining old model capabilities while improving new tasks.
problem Catastrophic forgetting in continual learning systems.
method Retention-centric framework with data-dependent constraints and an efficient constrained optimization algorithm.
result The method ensures that new models retain important capabilities of old models while improving new tasks.
Neural model detects DD risk in 5-year-olds, predicting 2 years ahead.
problem Early detection of developmental dyslexia for preventive teaching.
method Mixed neural model using auto-encoder and ordinal regression.
result System predicts DD risk 2 years before phonological processing is assessed.
Benchmark tests spoken language models for infant language learning.
problem Understanding how infants learn language from speech.
method Developed a language-acquisition-friendly benchmark.
result Benchmarking shows models' strengths and weaknesses.
MSBM extends SB for multi-marginal trajectory inference.
problem Trajectory inference from multiple discrete snapshots.
method Multi-Marginal Schrödinger Bridge Matching (MSBM) using iterative Markovian fitting (IMF).
result MSBM effectively captures complex trajectories and respects intermediate distributions.
Automates decision-making for human operators managing multiple robots.
problem Limited human operator attention when controlling multiple robots.
method Learned model of user preferences from easy settings to automatically identify the most critical robot.
result Automated decision-making can assist human operators in managing more robots than their attention allows.
3D CNN accurately classifies infant neurodevelopmental age from MRI scans.
problem Estimating neurodevelopmental age in infants from MRI data.
method 3D Convolutional Neural Network (3D CNN) trained on MRI images of 112 infants.
result 3D CNN achieves 99% sensitivity and 98.3% specificity in age classification.
Robotics: Rolling robots on a moving platform can be controlled.
problem Controlling the motion of rolling robots atop a moving platform.
method Developed a mathematical model and demonstrated simulations.
result Platform acceleration can control robot's heading and motion.
Robots learn to handle complex tasks creatively using DRL.
problem Robotic manipulation challenges and intelligence.
method Designing challenging manipulation tasks, applying DRL for robot training.
result Robots exhibit creative and non-intuitive problem-solving.
ROBEL platform accelerates reinforcement learning with low-cost robots.
problem Accelerating reinforcement learning research in robotics.
method Open-source platform of cost-effective robots for real-world reinforcement learning.
result Robots D'Claw and D'Kitty facilitate learning dexterous manipulation and agile locomotion tasks.
New method improves smoothness of robot learning.
problem Jerky motion patterns on real robots from Deep RL exploration.
method Adapting state-dependent exploration to Deep RL algorithms with gSDE.
result Improved exploration and performance on real robots.
Unified framework for Schrödinger Bridge solutions between arbitrary densities.
problem Generalizing generative models to arbitrary distributions.
method Unified closed-form framework for SB dynamics.
result Direct inference of SB dynamics from samples.
Robots learn to navigate rough terrain using reinforcement learning.
problem Generalizing robot behavior to new, unseen rough terrains.
method PPMC RL Training Algorithm
result Robots achieve 100% success rate in learning new rough terrain maps.
A new framework for robot block-stacking tasks using causal probabilistic models.
problem Robots fail outside controlled environments due to uncertainty and lack of explicit design for all scenarios.
method Causal probabilistic framework combining causal models and probabilistic representations of noise.
result Robots can perceive, reason about, and explain their environment for block-stacking tasks.
This research evaluates learning models for bionic robots, focusing on transfer function identification.
problem Developers need guidance on selecting and constructing transfer functions for bionic robots.
method Comprehensive evaluation strategy including data collection, learning model selection, comparative analysis, and transfer function identification.
result A framework for effectively dealing with multi-input multi-output robotic data.
Robots learn conservatively from human corrections, avoiding unintended changes to their objectives.
problem Robots learn from human corrections but may not align with the intended objectives due to misspecified hypothesis spaces.
method Robots reason in real-time about the relevance of human corrections to their hypothesis space, learning more conservatively.
result Robots can avoid unintended learning from human corrections, improving alignment with intended objectives.
A new Q-learning controller improves line follower robot control.
problem Challenges in controlling line follower robots due to unknown mechanical characteristics and uncertainties.
method Simulated annealing based Q learning method to address controller performance issues.
result The proposed controller outperforms conventional P controllers in line follower robots.
Neuro-robotics model shows gestures improve counting ability.
problem Improving counting ability in robots and children.
method Introduces a neuro-robotics model trained with pointing data, tests various model and training conditions.
result Model's performance aligns with human children's learning to count.
Paper addresses hypothesis space misspecification in learning from human demonstrations and corrections.
problem Hypothesis space misspecification in learning from human demonstrations and corrections.
method Reason explicitly about how well the robot can explain human inputs given its hypothesis space.
result Demonstrates method on a 7 DOF robot manipulator.
For robots to coexist with humans in a social world like ours, it is crucial that they possess human-like social interaction skills. Programming a robot to possess such skills is a challenging task. In this paper, we propose a Multimodal Deep Q-Network (MDQN) to enable a robot to learn human-like interaction skills thr…
Robot learns agile leg movements from simulations to real robots.
problem Training legged robots for dynamic maneuvers is challenging and expensive.
method Simulation-based reinforcement learning for real legged systems.
result ANYmal robot can follow high-level commands, run faster, and recover from falls.
The paper learns robot skills from demonstrations without supervision.
problem Discovering robotic options from unlabelled demonstrations.
method Temporal variational inference for latent variable learning.
result The framework can learn options across multiple datasets.
This work tackles force control for contact-rich manipulation tasks with rigid robots using RL.
problem Challenges in working with real robotic hardware, especially position-controlled robots.
method Combines RL with traditional force control techniques, implementing parallel position/force control and admittance control.
result Validated methods on both simulation and real robot (UR3 e-series) for force control.
Learning to control robots directly based on images is a primary challenge in robotics. However, many existing reinforcement learning approaches require iteratively obtaining millions of robot samples to learn a policy, which can take significant time. In this paper, we focus on learning a realistic world model capturi…
Study aims to develop a humanoid robot dialogue system.
problem Current dialogue systems lack attention to non-verbal cues.
method Participated in a competition to develop a system with facial expressions and gaze control.
result Developed a humanoid robot dialogue system.
Top 8 robotic vision systems tackled lifelong object recognition challenges.
problem Lifelong learning in robotic vision for varied, dynamic environments.
method Design of a dataset with diverse conditions and rules for evaluation.
result Robotic vision systems improved over time with dynamic object appearances.
Paper proposes a method to control robots of different shapes efficiently.
problem Learning optimal control policies for robots of various shapes is challenging.
method Hierarchical architecture with hypernetworks and fixed attention mechanism.
result Method improves learning performance and generalizes to unseen morphologies.
For a safe, natural and effective human-robot social interaction, it is essential to develop a system that allows a robot to demonstrate the perceivable responsive behaviors to complex human behaviors. We introduce the Multimodal Deep Attention Recurrent Q-Network using which the robot exhibits human-like social intera…
Reinforcement learning is a promising approach to developing hard-to-engineer adaptive solutions for complex and diverse robotic tasks. However, learning with real-world robots is often unreliable and difficult, which resulted in their low adoption in reinforcement learning research. This difficulty is worsened by the …
Robot solves Rubik's cube using simulation-trained models.
problem Solving Rubik's cube with a robot hand.
method Automatic domain randomization (ADR) and a custom robot platform.
result Control policies and vision state estimators trained with ADR exhibit improved sim2real transfer.
Robot learns new tasks sequentially without forgetting past ones.
problem Teaching a robot to solve tasks in a continual learning scenario.
method Policy distillation and sim2real transfer.
result Robot can solve all encountered tasks without forgetting past ones.
A new optimizer d-AmsGrad improves deep learning for robot learning in non-stationary problems.
problem Noise and outliers in real-world data make deep learning challenging for robot learning.
method Proposed an improved version of AmsGrad optimizer that slowly decays the maximum second momentum to adapt to non-stationary problems.
result The new optimizer outperformed baseline optimizers in robotics problems.
Robot learns from human demonstrations to work autonomously.
problem Leveraging human and robotic strengths in human-robot systems.
method Bayesian inference for detecting and classifying human heterogeneity.
result Bayesian approach outperforms conventional methods by up to 12.8. The paper formalizes robot environments using topological concepts.
problem Determining indistinguishable environments for robots.
method Formalizing robot systems as topological dynamical systems, using covering maps and bisimulation.
result Covering maps can witness indistinguishability of environments under general conditions.
Robot learns from human actions to perform complex tasks.
problem Learning complex skills from interaction data with embodiment differences.
method Formulated graphical model, treated action as observed variable, used domain-dependent prior.
result Robotic planning agent can learn tool use from human observations.
This thesis tackles learning reward functions from human comparative feedback.
problem Designing reward functions for complex tasks is challenging and humans often provide suboptimal demonstrations.
method Proposes learning reward functions from comparative feedback (pairwise comparisons, best-of-many choices, rankings, scaled comparisons) and active learning techniques.
result Demonstrates the effectiveness of learning reward functions from comparative feedback in various domains.
Applications of safety, security, and rescue in robotics, such as multi-robot target tracking, involve the execution of information acquisition tasks by teams of mobile robots. However, in failure-prone or adversarial environments, robots get attacked, their communication channels get jammed, and their sensors may fail…
Robot learns to imitate human interactions through deep learning.
problem Teaching robots to coordinate actions with human partners.
method Deep learning framework for motion embedding, prediction, and trajectory generation.
result Importance of predictive and adaptive components for successful imitation.
A conceptor-based approach helps robots recognize human internal states.
problem Recognizing human internal states for diagnostic purposes in autism therapy.
method A conceptor-based classifier to classify internal states.
result Initial results show potential for detailed diagnostic information.
Diffusion models enhance robotic manipulation through probabilistic multi-modal learning.
problem Enhancing robotic manipulation through robust and multi-modal learning.
method Probabilistic diffusion models integrating imitation and reinforcement learning.
result Diffusion models improve grasp learning, trajectory planning, and data augmentation in robotics.