Predictive Multi-Agent-Based Planning and Landing Controller for Reactive Dual-Arm Manipulation

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Autorschaft

  • Riddhiman Laha
  • Marvin Becker
  • Jonathan Vorndamme
  • Juraj Vrabel
  • Luis F.C. Figueredo
  • Matthias A. Muller
  • Sami Haddadin

Organisationseinheiten

Externe Organisationen

  • Technische Universität München (TUM)
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)864-885
Seitenumfang22
FachzeitschriftIEEE transactions on robotics
Jahrgang40
PublikationsstatusVeröffentlicht - 12 Dez. 2023

Abstract

Future robots operating in fast-changing anthropomorphic environments need to be reactive, safe, flexible, and intuitively use both arms (comparable to humans) to handle task-space constrained manipulation scenarios. Furthermore, dynamic environments pose additional challenges for motion planning due to a continual requirement for validation and refinement of plans. This work addresses the issues with vector-field-based motion generation strategies, which are often prone to local-minima problems. We aim to bridge the gap between reactive solutions, global planning, and constrained cooperative (two-arm) manipulation in partially known surroundings. To this end, we introduce novel planning and real-time control strategies leveraging the geometry of the task space that are inherently coupled for seamless operation in dynamic scenarios. Our integrated multiagent global planning and control scheme explores controllable sets in the previously introduced cooperative dual task space and flexibly controls them by exploiting the redundancy of the high degree-of-freedom (DOF) system. The planning and control framework is extensively validated in complex, cluttered, and nonstationary simulation scenarios where our framework is able to complete constrained tasks in a reliable manner, whereas existing solutions fail. We also perform additional real-world experiments with a two-armed 14 DOF torque-controlled KoBo robot. Our rigorous simulation studies and real-world experiments reinforce the claim that the framework is able to run robustly within the inner loop of modern collaborative robots with vision feedback.

ASJC Scopus Sachgebiete

Zitieren

Predictive Multi-Agent-Based Planning and Landing Controller for Reactive Dual-Arm Manipulation. / Laha, Riddhiman; Becker, Marvin; Vorndamme, Jonathan et al.
in: IEEE transactions on robotics, Jahrgang 40, 12.12.2023, S. 864-885.

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Laha R, Becker M, Vorndamme J, Vrabel J, Figueredo LFC, Muller MA et al. Predictive Multi-Agent-Based Planning and Landing Controller for Reactive Dual-Arm Manipulation. IEEE transactions on robotics. 2023 Dez 12;40:864-885. doi: 10.1109/TRO.2023.3341689
Laha, Riddhiman ; Becker, Marvin ; Vorndamme, Jonathan et al. / Predictive Multi-Agent-Based Planning and Landing Controller for Reactive Dual-Arm Manipulation. in: IEEE transactions on robotics. 2023 ; Jahrgang 40. S. 864-885.
Download
@article{81c33c9c884c47cfaa2155c9c235f81f,
title = "Predictive Multi-Agent-Based Planning and Landing Controller for Reactive Dual-Arm Manipulation",
abstract = "Future robots operating in fast-changing anthropomorphic environments need to be reactive, safe, flexible, and intuitively use both arms (comparable to humans) to handle task-space constrained manipulation scenarios. Furthermore, dynamic environments pose additional challenges for motion planning due to a continual requirement for validation and refinement of plans. This work addresses the issues with vector-field-based motion generation strategies, which are often prone to local-minima problems. We aim to bridge the gap between reactive solutions, global planning, and constrained cooperative (two-arm) manipulation in partially known surroundings. To this end, we introduce novel planning and real-time control strategies leveraging the geometry of the task space that are inherently coupled for seamless operation in dynamic scenarios. Our integrated multiagent global planning and control scheme explores controllable sets in the previously introduced cooperative dual task space and flexibly controls them by exploiting the redundancy of the high degree-of-freedom (DOF) system. The planning and control framework is extensively validated in complex, cluttered, and nonstationary simulation scenarios where our framework is able to complete constrained tasks in a reliable manner, whereas existing solutions fail. We also perform additional real-world experiments with a two-armed 14 DOF torque-controlled KoBo robot. Our rigorous simulation studies and real-world experiments reinforce the claim that the framework is able to run robustly within the inner loop of modern collaborative robots with vision feedback.",
keywords = "Collision avoidance, dual-arm manipulation, motion and path planning, reactive and sensor-based planning",
author = "Riddhiman Laha and Marvin Becker and Jonathan Vorndamme and Juraj Vrabel and Figueredo, {Luis F.C.} and Muller, {Matthias A.} and Sami Haddadin",
year = "2023",
month = dec,
day = "12",
doi = "10.1109/TRO.2023.3341689",
language = "English",
volume = "40",
pages = "864--885",
journal = "IEEE transactions on robotics",
issn = "1552-3098",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

Download

TY - JOUR

T1 - Predictive Multi-Agent-Based Planning and Landing Controller for Reactive Dual-Arm Manipulation

AU - Laha, Riddhiman

AU - Becker, Marvin

AU - Vorndamme, Jonathan

AU - Vrabel, Juraj

AU - Figueredo, Luis F.C.

AU - Muller, Matthias A.

AU - Haddadin, Sami

PY - 2023/12/12

Y1 - 2023/12/12

N2 - Future robots operating in fast-changing anthropomorphic environments need to be reactive, safe, flexible, and intuitively use both arms (comparable to humans) to handle task-space constrained manipulation scenarios. Furthermore, dynamic environments pose additional challenges for motion planning due to a continual requirement for validation and refinement of plans. This work addresses the issues with vector-field-based motion generation strategies, which are often prone to local-minima problems. We aim to bridge the gap between reactive solutions, global planning, and constrained cooperative (two-arm) manipulation in partially known surroundings. To this end, we introduce novel planning and real-time control strategies leveraging the geometry of the task space that are inherently coupled for seamless operation in dynamic scenarios. Our integrated multiagent global planning and control scheme explores controllable sets in the previously introduced cooperative dual task space and flexibly controls them by exploiting the redundancy of the high degree-of-freedom (DOF) system. The planning and control framework is extensively validated in complex, cluttered, and nonstationary simulation scenarios where our framework is able to complete constrained tasks in a reliable manner, whereas existing solutions fail. We also perform additional real-world experiments with a two-armed 14 DOF torque-controlled KoBo robot. Our rigorous simulation studies and real-world experiments reinforce the claim that the framework is able to run robustly within the inner loop of modern collaborative robots with vision feedback.

AB - Future robots operating in fast-changing anthropomorphic environments need to be reactive, safe, flexible, and intuitively use both arms (comparable to humans) to handle task-space constrained manipulation scenarios. Furthermore, dynamic environments pose additional challenges for motion planning due to a continual requirement for validation and refinement of plans. This work addresses the issues with vector-field-based motion generation strategies, which are often prone to local-minima problems. We aim to bridge the gap between reactive solutions, global planning, and constrained cooperative (two-arm) manipulation in partially known surroundings. To this end, we introduce novel planning and real-time control strategies leveraging the geometry of the task space that are inherently coupled for seamless operation in dynamic scenarios. Our integrated multiagent global planning and control scheme explores controllable sets in the previously introduced cooperative dual task space and flexibly controls them by exploiting the redundancy of the high degree-of-freedom (DOF) system. The planning and control framework is extensively validated in complex, cluttered, and nonstationary simulation scenarios where our framework is able to complete constrained tasks in a reliable manner, whereas existing solutions fail. We also perform additional real-world experiments with a two-armed 14 DOF torque-controlled KoBo robot. Our rigorous simulation studies and real-world experiments reinforce the claim that the framework is able to run robustly within the inner loop of modern collaborative robots with vision feedback.

KW - Collision avoidance

KW - dual-arm manipulation

KW - motion and path planning

KW - reactive and sensor-based planning

UR - http://www.scopus.com/inward/record.url?scp=85180338259&partnerID=8YFLogxK

U2 - 10.1109/TRO.2023.3341689

DO - 10.1109/TRO.2023.3341689

M3 - Article

AN - SCOPUS:85180338259

VL - 40

SP - 864

EP - 885

JO - IEEE transactions on robotics

JF - IEEE transactions on robotics

SN - 1552-3098

ER -

Von denselben Autoren