Harmony: Enhancing Healthcare with Assistive Robotic Mobile Manipulation

New H2020 Project awarded to enable flexible and safe autonomous mobile manipulation robots for use in human-centred environments.

Concept of HARMONY H2020 Project

Professor Sethu Vijayakumar leads an Edinburgh team with co-PIs Dr. Zhibin (Alex) Li, Dr. Vladimir Ivan and Dr. Mohsen Khadem, looking at flexible and safe autonomous mobile manipulation robots for use in human-centred environments -- aiming to make fundamental contributions in cognitive mechatronic technologies as part of their new H2020 project, HARMONY.

Project Duration: January 2020-June 2024

The work will contribute to the wider consortium with the project partners: ETH Zurich (coordinator), TU Delft, University of Bonn, University of Twente, CREATE, ABB and healthcare partners such as Karolinska University Hospital and University Hospital Zurich.

The vision of Harmony is to enable robust, flexible and safe autonomous mobile manipulation technology for use in human-centred environments. The team will need to make several fundamental contributions to existing cognitive mechatronic technologies, i.e. a combination of better machines as well as better action and awareness. The success of the project also relies on integrating these technologies into a user-intuitive framework, ultimately enabling robotic mobile manipulation systems that can integrate seamlessly into our existing spaces without the need to fully re-engineer our environments for robot operation.

The consortium will develop perception to formalise an object-based world representation; robotic localisation and mapping for an object-based environment; motion planning to provide adaptive, congestion-free motion plans in human-centred spaces; learning methods for grasping and manipulation from demonstration via an immersive control interface; robust and compliant whole-body motion planning and control for interacting with unknown objects; and human-robot interaction to deliver safety and acceptability recommendations for the use of mobile manipulators in human-centred environments.

Edinburgh's role in the consortium will be to develop robust , flexible and adaptive dual arm manipulation on mobile loco-manipulaiton platforms such as the Kawada Nextage -- addressing both dynamic motion plannning under challenging environments as well as compliant, real-time control.

The target use cases lie in the healthcare domain and we will work with partners hospitals (University Hospital Zurich and Karolinska University Hospital) to deploy and test robots in the real-world settings. In addition, the objectives of Harmony will address both scientific/technical advancements as well as ethical/regulatory issues. Both play an important role in promoting industry take-up and social acceptance and a combined assessment will substantially elevate the tangible outcomes of the project.


Further Information