DeepWeeds dataset aids in robust weed species classification for rangeland robotics.
problem Robust classification of weed species in rangeland environments.
method Development of a large multiclass image dataset and application of deep learning models.
result Inception-v3 and ResNet-50 achieved 95.1% and 95.7% classification accuracy, respectively.
Conformal prediction ensures reliable weed spraying guarantees.
problem Lack of trust in deep learning-based precision weeding systems.
method Conformal prediction for providing trustworthy guarantees on black-box models.
result Formal guarantees on spraying at least 90% of weeds.
New method improves conformal prediction for machine learning models.
problem Improving the efficiency and informativeness of conformal prediction models.
method Introduces Penalized Inverse Probability (PIP) and Regularized PIP (RePIP) nonconformity score functions.
result PIP-based conformal classifiers strike a good balance between informativeness and efficiency.
New method uses UAV imagery and ML to map crops and weeds.
problem Mapping crops and weeds at high resolution.
method Machine Learning algorithms trained on expert-masked images.
result Maps with >90% identification efficiency at 5m altitude.
A new Q-learning controller improves line follower robot control.
problem Challenges in controlling line follower robots due to unknown mechanical characteristics and uncertainties.
method Simulated annealing based Q learning method to address controller performance issues.
result The proposed controller outperforms conventional P controllers in line follower robots.
This work tackles force control for contact-rich manipulation tasks with rigid robots using RL.
problem Challenges in working with real robotic hardware, especially position-controlled robots.
method Combines RL with traditional force control techniques, implementing parallel position/force control and admittance control.
result Validated methods on both simulation and real robot (UR3 e-series) for force control.
Automates decision-making for human operators managing multiple robots.
problem Limited human operator attention when controlling multiple robots.
method Learned model of user preferences from easy settings to automatically identify the most critical robot.
result Automated decision-making can assist human operators in managing more robots than their attention allows.
Paper proposes a method to control robots of different shapes efficiently.
problem Learning optimal control policies for robots of various shapes is challenging.
method Hierarchical architecture with hypernetworks and fixed attention mechanism.
result Method improves learning performance and generalizes to unseen morphologies.
Robots learn to handle complex tasks creatively using DRL.
problem Robotic manipulation challenges and intelligence.
method Designing challenging manipulation tasks, applying DRL for robot training.
result Robots exhibit creative and non-intuitive problem-solving.
This research evaluates learning models for bionic robots, focusing on transfer function identification.
problem Developers need guidance on selecting and constructing transfer functions for bionic robots.
method Comprehensive evaluation strategy including data collection, learning model selection, comparative analysis, and transfer function identification.
result A framework for effectively dealing with multi-input multi-output robotic data.
A decentralized deep RL controller improves hexapod locomotion learning.
problem Deep RL struggles with real-world legged robot control.
method Decentralized deep RL on a hexapod robot.
result Decentralized approach learns better and faster.
Robotics: Rolling robots on a moving platform can be controlled.
problem Controlling the motion of rolling robots atop a moving platform.
method Developed a mathematical model and demonstrated simulations.
result Platform acceleration can control robot's heading and motion.
Learning robot tasks or controllers using deep reinforcement learning has been proven effective in simulations. Learning in simulation has several advantages. For example, one can fully control the simulated environment, including halting motions while performing computations. Another advantage when robots are involved…
RL controls small soccer robots in a real league, beating human-designed policies.
problem Training robots to play complex, real-world sports.
method Sim-to-Real RL approach, training in simulated environment, applying to real-world robots.
result Robots learned policies to compete effectively, beating human-designed strategies.
The paper presents a method to improve trust in deep learning models for crop and weed classification.
problem Lack of user trust in deep learning models for precision agriculture due to their complexity and uncertainty.
method Group-conditional conformal prediction via quantile regression calibration.
result The proposed method provides valid statistical guarantees on the predictive performance of deep learning models.
Hybrid method uses GP models to control robot trajectories.
problem Minimizing unmodeled dynamics in robot motion.
method Embeds non-parametric statistical models (GPs) for feedback control.
result Proposed method avoids complex analysis for wide trajectory classes.
Method trains vision and control policies on real robots quickly.
problem Training vision-based control policies on real robots efficiently.
method Multi-task Reinforcement Learning with auxiliary tasks.
result Significant learning speed-ups and task learning from-scratch.
Robot solves Rubik's cube using simulation-trained models.
problem Solving Rubik's cube with a robot hand.
method Automatic domain randomization (ADR) and a custom robot platform.
result Control policies and vision state estimators trained with ADR exhibit improved sim2real transfer.
A new reinforcement learning method for robots thinking and moving simultaneously.
problem Concurrent control in robotic systems where actions must be decided while the system is still evolving.
method Continuous-time Bellman equations, discretization aware of system delays, and architectural extension to deep reinforcement learning.
result The method successfully handles tasks requiring simultaneous decision-making and action execution.
New sensor placement affects robot controller learnability.
problem Catastrophic forgetting in neural controllers for robots.
method Demonstrated how sensor placement alters loss function manifolds.
result Sensor placement can reduce or induce catastrophic forgetting.
Novel approach for sim-to-real transfer using MPC and task representations.
problem Difficulty of sim-to-real transfer systems producing generalizable policies.
method Model-predictive control (MPC) and task representation learning.
result Direct transfer of multi-skill policy to real robot for unseen tasks.
Motion planning and control are key problems in a collection of robotic applications including the design of autonomous agile vehicles and of minimalist manipulators. These problems can be accurately formalized within the language of affine connections and of geometric control theory. In this paper we overview recent r…
In this paper we present a geometric control law for position and line-of-sight stabilization of the nonholonomic spherical robot actuated by three independent actuators. A simple configuration error function with an appropriately defined transport map is proposed to extract feedforward and proportional-derivative cont…
Paper learns robot's end-effector position without prior info.
problem Lack of prior robot structure or sensor info.
method Generates internal end-effector config from raw data.
result Can control robot without prior kinematic info.
Study aims to develop a humanoid robot dialogue system.
problem Current dialogue systems lack attention to non-verbal cues.
method Participated in a competition to develop a system with facial expressions and gaze control.
result Developed a humanoid robot dialogue system.
Robot-assisted dressing offers an opportunity to benefit the lives of many people with disabilities, such as some older adults. However, robots currently lack common sense about the physical implications of their actions on people. The physical implications of dressing are complicated by non-rigid garments, which can r…
Robot learns to control itself without rewards.
problem Autonomous reinforcement learning without access to rewards.
method Distributional planning networks optimizing for an embedding space.
result Learned goal metrics enable autonomous reinforcement learning.
A novel controller for wheeled robots handles joystick inputs for smooth steering.
problem Steering control for differential-drive wheeled robots from indirect joystick inputs.
method Developed a geometric controller based on Darboux frame kinematics.
result Smooth trajectories achieved with safety constraints and no desired states.
Deep RL trains a robust humanoid push-recovery policy.
problem Training robust humanoid push-recovery policies.
method Model-free Deep Reinforcement Learning.
result Policy learns robust behaviors across the entire body.
We construct a privileged system of coordinates with respect to the controlling distribution of a trident snake robot and, furthermore, we construct a nilpotent approximation with respect to the given filtration. Note that all constructions are local in the neighbourhood of a particular point. We compare the motions co…
The paper addresses optimal control on Riemannian manifolds, introducing biased splines for robotic systems.
problem Optimal control on Riemannian manifolds with a mathematically natural cometric not capturing true motion cost.
method Encoding torque-based actuators into a cometric, characterizing optimal solutions via a 4th order differential equation.
result Identified a tensor as the geometric source of biasing solutions away from ordinary splines and geodesics.
Action chunking and data exploration improve behavior cloning in robotics.
problem Exponential errors in learning from demonstrations for continuous control tasks.
method Action chunking and exploratory data collection.
result Control-theoretic stability is key to improving imitation learning.
Robots learn to navigate rough terrain using reinforcement learning.
problem Generalizing robot behavior to new, unseen rough terrains.
method PPMC RL Training Algorithm
result Robots achieve 100% success rate in learning new rough terrain maps.
This work evaluates task-agnostic exploration methods for fixed-batch learning.
problem Expensive real-world experience for robotics tasks.
method Fixed datasets for arbitrary task learning.
result Improved offline learning for robotics tasks.
TIDBD adapts step sizes online for better robotic predictions.
problem Choosing appropriate learning parameters for online prediction-learning.
method Temporal-Difference Incremental Delta-Bar-Delta (TIDBD) for step-size adaptation.
result TIDBD performs comparably to classic TD learning and detects sensor failures.
Paper proposes a new method to optimize robot body structure and control policy.
problem Optimizing robot body structure and control policy in a coupled manner.
method Revisits co-design problem as a Stackelberg game, incorporating control adaptation dynamics.
result Stackelberg PPO outperforms standard PPO in stability and performance.
Paper provides closed-form time derivatives for rigid body systems.
problem Need for time derivatives of equations of motion in robotics.
method Lie group formulation for rigid body systems to derive closed-form derivatives up to second-order.
result Closed-form equations provide direct insight into system dynamics.
A new RL framework handles autocorrelated actions for better learning and stability.
problem Improving reinforcement learning algorithms for better stability and efficiency.
method Introduces a new algorithm that optimizes policies with autocorrelated actions.
result The new algorithm outperforms existing methods in four simulated control problems.
Autonomous learning has been a promising direction in control and robotics for more than a decade since data-driven learning allows to reduce the amount of engineering knowledge, which is otherwise required. However, autonomous reinforcement learning (RL) approaches typically require many interactions with the system t…
Paper learns versatile balancing and recovery motions for humanoid robots.
problem Training humanoid robots to handle unexpected perturbations.
method Hierarchical Deep Reinforcement Learning in a physics simulator.
result Learned skills comparable to preprogrammed controllers but more adaptable.
This paper improves robot grasping by integrating meta-control and latent-space imagination.
problem Dual-system approaches fail to consider the reliability of the learned model when making multiple-step predictions.
method A meta-controller arbitrates between model-based and model-free decisions based on local reliability, encouraging actions that improve the model and generating imagined experiences for additional training.
result Our approach learns near-optimal grasping policies in dense- and sparse-reward environments, outperforming baseline and state-of-the-art methods.
We propose a neural information processing system which is obtained by re-purposing the function of a biological neural circuit model, to govern simulated and real-world control tasks. Inspired by the structure of the nervous system of the soil-worm, C. elegans, we introduce Neuronal Circuit Policies (NCPs), defined as…
New method transfers robotic control policies to unknown environments using a family of policies.
problem Transfer of robotic control policies trained in simulation to real hardware is difficult due to environment differences.
method Simultaneously learns a family of policies with different behaviors; searches for the best policy based on task performance.
result Demonstrates superior performance in unknown environments compared to other methods, overcoming larger modeling errors.
MVPI framework optimizes risk in reinforcement learning, improving performance in robot simulations.
problem Optimizing risk in reinforcement learning control problems.
method Mean-Variance Policy Iteration (MVPI) framework for risk-averse control in MDPs.
result Risk-averse TD3 outperforms previous methods in robot simulation tasks.
This work uses QPGPs to improve ILC performance in repetitive tasks.
problem Performance degradation in repetitive motion tasks due to environmental changes and robot wear.
method Incorporates Quasi-Periodic Gaussian Processes into a predictive ILC framework.
result The proposed approach achieves faster convergence and robustness under disturbances.
Deep RL controls robotic arms efficiently.
problem Continuous control of robotic arms.
method Combination of two reinforcement learning methods and preprocessing techniques.
result The new combination learns more effectively than a baseline.
Robotic table tennis learns efficient policies to return balls at 100Hz.
problem Developing efficient robotic table tennis strategies.
method Model-free reinforcement learning using evolutionary search on CNN-based policies.
result Robots can develop multi-modal styles (forehand and backhand) with 80% return rate.
Data-driven control of robotic systems using Koopman operators with error bounds.
problem Real-time control of nonlinear robotic systems with unknown dynamics.
method Constructing a Koopman operator-based linear representation using higher-order derivatives of nonlinear dynamics, with error bounds derived from Taylor series accuracy analysis.
result The Koopman model provides marginally better performance than competing nonlinear modeling methods and can be efficiently controlled using linear control design tools.