Service robots learn new tasks more efficiently with ISI, improving query performance and reducing training time.
problem Incremental learning of semantic concepts in multi-relational embeddings for service robots.
method Incremental Semantic Initialization (ISI) that allows new semantic concepts to be initialized in relation to previously learned embeddings.
result ISI improves immediate query performance by 41.4% and reduces the number of epochs to approach model convergence by 78.2%.
Paper tackles non-uniform coverage planning for robots.
problem Non-uniform coverage planning for robots that need to visit some points more frequently.
method Proposes a novel reinforcement learning approach in a Semi-Markov Decision Process.
result Significant improvement over existing greedy approach in simulations.
Applications of safety, security, and rescue in robotics, such as multi-robot target tracking, involve the execution of information acquisition tasks by teams of mobile robots. However, in failure-prone or adversarial environments, robots get attacked, their communication channels get jammed, and their sensors may fail…
Perception is fundamental to many robot application areas especially in service robotics. Our aim is to perceive and model an unprepared kitchen scenario with many objects. We start with the perception of a single target object. The modeling relies especially on fusing and merging of weak information from the sensors o…
Automated service classification plays a crucial role in service discovery, selection, and composition. Machine learning has been widely used for service classification in recent years. However, the performance of conventional machine learning methods highly depends on the quality of manual feature engineering. In this…
The paper uses Bayesian Surprise to identify unexpected structures in indoor environments.
problem Identifying unexpected structures in indoor environments.
method Bayesian Surprise applied to Isovist Analysis of 2D floor plans.
result Surprise regions in indoor environments can be used to focus on important areas in LBS.
Automates decision-making for human operators managing multiple robots.
problem Limited human operator attention when controlling multiple robots.
method Learned model of user preferences from easy settings to automatically identify the most critical robot.
result Automated decision-making can assist human operators in managing more robots than their attention allows.
OTT services are replacing traditional telecom services, affecting revenue streams.
problem OTT services are reducing traditional telecom revenue streams.
method Quantitative analysis of mobile user trends and revenue changes.
result OTT services are becoming more prevalent and impacting telecom revenue.
Proposes a neural network solution for queuing dynamics.
problem Modeling service system dynamics with limited parametric assumptions.
method Combines recurrent neural networks and generative adversarial networks.
result Evaluates solution on various datasets, demonstrating effectiveness.
Paper proposes machine learning for pricing 3D printing services in marketplaces.
problem Inefficient pricing methods for 3D printing services in marketplaces.
method Data mining and machine learning methods to estimate price ranges based on supplier and customer characteristics.
result Machine learning model achieves 65% accuracy for US suppliers and 59% for Europe suppliers in classifying 3D printer listings.
Economic complexity reflects the amount of knowledge that is embedded in the productive structure of an economy. By combining tools from network science and econometrics, a robust and stable relationship between a country's productive structure and its economic growth has been established. Here we report that not only …
Robotics: Rolling robots on a moving platform can be controlled.
problem Controlling the motion of rolling robots atop a moving platform.
method Developed a mathematical model and demonstrated simulations.
result Platform acceleration can control robot's heading and motion.
Robots learn to handle complex tasks creatively using DRL.
problem Robotic manipulation challenges and intelligence.
method Designing challenging manipulation tasks, applying DRL for robot training.
result Robots exhibit creative and non-intuitive problem-solving.
This papers presents a deep learning-based framework to predict crowdsourced service availability spatially and temporally. A novel two-stage prediction model is introduced based on historical spatio-temporal traces of mobile crowdsourced services. The prediction model first clusters mobile crowdsourced services into r…
ROBEL platform accelerates reinforcement learning with low-cost robots.
problem Accelerating reinforcement learning research in robotics.
method Open-source platform of cost-effective robots for real-world reinforcement learning.
result Robots D'Claw and D'Kitty facilitate learning dexterous manipulation and agile locomotion tasks.
This paper tackles fair same-day delivery service by optimizing regional service rates.
problem Fairness in same-day delivery service for different neighborhoods.
method Partition service area into regions, use multi-objective Markov decision process and deep Q-learning.
result Our approach maximizes fairness across all regions while maintaining overall service rate.
New method improves smoothness of robot learning.
problem Jerky motion patterns on real robots from Deep RL exploration.
method Adapting state-dependent exploration to Deep RL algorithms with gSDE.
result Improved exploration and performance on real robots.
DeepSIP predicts network failures' impact using CNN from syslog and traffic data.
problem Predicting service impact from network failures.
method Temporal multimodal CNN for predicting time to recovery and traffic loss.
result DeepSIP reduced prediction error by approximately 50%.
Robots learn to navigate rough terrain using reinforcement learning.
problem Generalizing robot behavior to new, unseen rough terrains.
method PPMC RL Training Algorithm
result Robots achieve 100% success rate in learning new rough terrain maps.
A new framework for robot block-stacking tasks using causal probabilistic models.
problem Robots fail outside controlled environments due to uncertainty and lack of explicit design for all scenarios.
method Causal probabilistic framework combining causal models and probabilistic representations of noise.
result Robots can perceive, reason about, and explain their environment for block-stacking tasks.
This research evaluates learning models for bionic robots, focusing on transfer function identification.
problem Developers need guidance on selecting and constructing transfer functions for bionic robots.
method Comprehensive evaluation strategy including data collection, learning model selection, comparative analysis, and transfer function identification.
result A framework for effectively dealing with multi-input multi-output robotic data.
A new Q-learning controller improves line follower robot control.
problem Challenges in controlling line follower robots due to unknown mechanical characteristics and uncertainties.
method Simulated annealing based Q learning method to address controller performance issues.
result The proposed controller outperforms conventional P controllers in line follower robots.
Neuro-robotics model shows gestures improve counting ability.
problem Improving counting ability in robots and children.
method Introduces a neuro-robotics model trained with pointing data, tests various model and training conditions.
result Model's performance aligns with human children's learning to count.
Paper addresses hypothesis space misspecification in learning from human demonstrations and corrections.
problem Hypothesis space misspecification in learning from human demonstrations and corrections.
method Reason explicitly about how well the robot can explain human inputs given its hypothesis space.
result Demonstrates method on a 7 DOF robot manipulator.
For robots to coexist with humans in a social world like ours, it is crucial that they possess human-like social interaction skills. Programming a robot to possess such skills is a challenging task. In this paper, we propose a Multimodal Deep Q-Network (MDQN) to enable a robot to learn human-like interaction skills thr…
The paper learns robot skills from demonstrations without supervision.
problem Discovering robotic options from unlabelled demonstrations.
method Temporal variational inference for latent variable learning.
result The framework can learn options across multiple datasets.
This work tackles force control for contact-rich manipulation tasks with rigid robots using RL.
problem Challenges in working with real robotic hardware, especially position-controlled robots.
method Combines RL with traditional force control techniques, implementing parallel position/force control and admittance control.
result Validated methods on both simulation and real robot (UR3 e-series) for force control.
Learning to control robots directly based on images is a primary challenge in robotics. However, many existing reinforcement learning approaches require iteratively obtaining millions of robot samples to learn a policy, which can take significant time. In this paper, we focus on learning a realistic world model capturi…
Study aims to develop a humanoid robot dialogue system.
problem Current dialogue systems lack attention to non-verbal cues.
method Participated in a competition to develop a system with facial expressions and gaze control.
result Developed a humanoid robot dialogue system.
Learning robot objective functions from human input has become increasingly important, but state-of-the-art techniques assume that the human's desired objective lies within the robot's hypothesis space. When this is not true, even methods that keep track of uncertainty over the objective fail because they reason about …
Top 8 robotic vision systems tackled lifelong object recognition challenges.
problem Lifelong learning in robotic vision for varied, dynamic environments.
method Design of a dataset with diverse conditions and rules for evaluation.
result Robotic vision systems improved over time with dynamic object appearances.
An online learning framework optimizes pricing and capacity in service systems.
problem Optimizing pricing and capacity in dynamic service systems.
method Gradient-based Online Learning in Queue (GOLiQ) framework.
result GOLiQ achieves logarithmic regret bound and improves service provider's performance.
Paper proposes a method to control robots of different shapes efficiently.
problem Learning optimal control policies for robots of various shapes is challenging.
method Hierarchical architecture with hypernetworks and fixed attention mechanism.
result Method improves learning performance and generalizes to unseen morphologies.
Optimizes resource allocation for virtualized network functions based on performance profiles.
problem Mapping SLA performance requirements to dynamic virtualized infrastructure resources.
method Profile-based resource allocation using VNF performance datasets and machine learning models.
result A method to predict and recommend optimal resource allocation for network services.
For a safe, natural and effective human-robot social interaction, it is essential to develop a system that allows a robot to demonstrate the perceivable responsive behaviors to complex human behaviors. We introduce the Multimodal Deep Attention Recurrent Q-Network using which the robot exhibits human-like social intera…
Reinforcement learning is a promising approach to developing hard-to-engineer adaptive solutions for complex and diverse robotic tasks. However, learning with real-world robots is often unreliable and difficult, which resulted in their low adoption in reinforcement learning research. This difficulty is worsened by the …
Robot solves Rubik's cube using simulation-trained models.
problem Solving Rubik's cube with a robot hand.
method Automatic domain randomization (ADR) and a custom robot platform.
result Control policies and vision state estimators trained with ADR exhibit improved sim2real transfer.
Robot learns new tasks sequentially without forgetting past ones.
problem Teaching a robot to solve tasks in a continual learning scenario.
method Policy distillation and sim2real transfer.
result Robot can solve all encountered tasks without forgetting past ones.
A new optimizer d-AmsGrad improves deep learning for robot learning in non-stationary problems.
problem Noise and outliers in real-world data make deep learning challenging for robot learning.
method Proposed an improved version of AmsGrad optimizer that slowly decays the maximum second momentum to adapt to non-stationary problems.
result The new optimizer outperformed baseline optimizers in robotics problems.
This work analyzes how users and services adapt to reduce risk, leading to specialization.
problem Adaptation of users and services to reduce risk affects learning and performance.
method Analyzed a class of dynamics where users allocate participation and services update parameters.
result Repeated myopic updates with multiple learners lead to better outcomes than repeated risk minimization.
Robot learns from human demonstrations to work autonomously.
problem Leveraging human and robotic strengths in human-robot systems.
method Bayesian inference for detecting and classifying human heterogeneity.
result Bayesian approach outperforms conventional methods by up to 12.8. The paper formalizes robot environments using topological concepts.
problem Determining indistinguishable environments for robots.
method Formalizing robot systems as topological dynamical systems, using covering maps and bisimulation.
result Covering maps can witness indistinguishability of environments under general conditions.
Robot learns from human actions to perform complex tasks.
problem Learning complex skills from interaction data with embodiment differences.
method Formulated graphical model, treated action as observed variable, used domain-dependent prior.
result Robotic planning agent can learn tool use from human observations.
This thesis tackles learning reward functions from human comparative feedback.
problem Designing reward functions for complex tasks is challenging and humans often provide suboptimal demonstrations.
method Proposes learning reward functions from comparative feedback (pairwise comparisons, best-of-many choices, rankings, scaled comparisons) and active learning techniques.
result Demonstrates the effectiveness of learning reward functions from comparative feedback in various domains.
Robot learns to imitate human interactions through deep learning.
problem Teaching robots to coordinate actions with human partners.
method Deep learning framework for motion embedding, prediction, and trajectory generation.
result Importance of predictive and adaptive components for successful imitation.
A conceptor-based approach helps robots recognize human internal states.
problem Recognizing human internal states for diagnostic purposes in autism therapy.
method A conceptor-based classifier to classify internal states.
result Initial results show potential for detailed diagnostic information.
Diffusion models enhance robotic manipulation through probabilistic multi-modal learning.
problem Enhancing robotic manipulation through robust and multi-modal learning.
method Probabilistic diffusion models integrating imitation and reinforcement learning.
result Diffusion models improve grasp learning, trajectory planning, and data augmentation in robotics.
RL controls small soccer robots in a real league, beating human-designed policies.
problem Training robots to play complex, real-world sports.
method Sim-to-Real RL approach, training in simulated environment, applying to real-world robots.
result Robots learned policies to compete effectively, beating human-designed strategies.