Loading [MathJax]/extensions/tex2jax.js

A Point-and-Click Augmented Reality Approach Towards Pose Estimation for Robot Programming

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Details

Original languageEnglish
Title of host publication2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
Pages1250-1254
Number of pages5
ISBN (electronic)9798350378931
Publication statusPublished - 4 Mar 2025
Event20th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2025 - Melbourne, Australia
Duration: 4 Mar 20256 Mar 2025

Publication series

NameACM/IEEE International Conference on Human-Robot Interaction
ISSN (electronic)2167-2148

Abstract

Augmented Reality (AR)-based programming approaches hold great promise for addressing the challenges of flexible automation by facilitating fast and intuitive programming processes. Pose estimation of novel objects enhances the program-ming experience by bridging the real and virtual environments. However, a prerequisite for pose estimation is to perform a 2D segmentation to determine the region of interest (ROI). In this work, we present an AR-based approach that enables point-and-click ROI detection through human interaction. Our proof of concept investigates how the achievable accuracy varies with the quality of the user input. The results show that the accuracy of the ROI estimation has a minimal impact on the overall accuracy. Existing limitations can be addressed by other approaches presented.

Keywords

    augmented reality, HMD, human-robot collaboration, intuitive programming, pose estimation

ASJC Scopus subject areas

Cite this

A Point-and-Click Augmented Reality Approach Towards Pose Estimation for Robot Programming. / Blankemeyer, Sebastian; Wendorff, David; Raatz, Annika.
2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 2025. p. 1250-1254 (ACM/IEEE International Conference on Human-Robot Interaction).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Blankemeyer, S, Wendorff, D & Raatz, A 2025, A Point-and-Click Augmented Reality Approach Towards Pose Estimation for Robot Programming. in 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI). ACM/IEEE International Conference on Human-Robot Interaction, pp. 1250-1254, 20th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2025, Melbourne, Victoria, Australia, 4 Mar 2025. https://doi.org/10.1109/HRI61500.2025.10974140
Blankemeyer, S., Wendorff, D., & Raatz, A. (2025). A Point-and-Click Augmented Reality Approach Towards Pose Estimation for Robot Programming. In 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (pp. 1250-1254). (ACM/IEEE International Conference on Human-Robot Interaction). https://doi.org/10.1109/HRI61500.2025.10974140
Blankemeyer S, Wendorff D, Raatz A. A Point-and-Click Augmented Reality Approach Towards Pose Estimation for Robot Programming. In 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 2025. p. 1250-1254. (ACM/IEEE International Conference on Human-Robot Interaction). doi: 10.1109/HRI61500.2025.10974140
Blankemeyer, Sebastian ; Wendorff, David ; Raatz, Annika. / A Point-and-Click Augmented Reality Approach Towards Pose Estimation for Robot Programming. 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 2025. pp. 1250-1254 (ACM/IEEE International Conference on Human-Robot Interaction).
Download
@inproceedings{79463b7511694dcdab262a7d21282363,
title = "A Point-and-Click Augmented Reality Approach Towards Pose Estimation for Robot Programming",
abstract = "Augmented Reality (AR)-based programming approaches hold great promise for addressing the challenges of flexible automation by facilitating fast and intuitive programming processes. Pose estimation of novel objects enhances the program-ming experience by bridging the real and virtual environments. However, a prerequisite for pose estimation is to perform a 2D segmentation to determine the region of interest (ROI). In this work, we present an AR-based approach that enables point-and-click ROI detection through human interaction. Our proof of concept investigates how the achievable accuracy varies with the quality of the user input. The results show that the accuracy of the ROI estimation has a minimal impact on the overall accuracy. Existing limitations can be addressed by other approaches presented.",
keywords = "augmented reality, HMD, human-robot collaboration, intuitive programming, pose estimation",
author = "Sebastian Blankemeyer and David Wendorff and Annika Raatz",
note = "Publisher Copyright: {\textcopyright} 2025 IEEE.; 20th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2025, HRI 2025 ; Conference date: 04-03-2025 Through 06-03-2025",
year = "2025",
month = mar,
day = "4",
doi = "10.1109/HRI61500.2025.10974140",
language = "English",
isbn = "979-8-3503-7894-8",
series = "ACM/IEEE International Conference on Human-Robot Interaction",
pages = "1250--1254",
booktitle = "2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI)",

}

Download

TY - GEN

T1 - A Point-and-Click Augmented Reality Approach Towards Pose Estimation for Robot Programming

AU - Blankemeyer, Sebastian

AU - Wendorff, David

AU - Raatz, Annika

N1 - Publisher Copyright: © 2025 IEEE.

PY - 2025/3/4

Y1 - 2025/3/4

N2 - Augmented Reality (AR)-based programming approaches hold great promise for addressing the challenges of flexible automation by facilitating fast and intuitive programming processes. Pose estimation of novel objects enhances the program-ming experience by bridging the real and virtual environments. However, a prerequisite for pose estimation is to perform a 2D segmentation to determine the region of interest (ROI). In this work, we present an AR-based approach that enables point-and-click ROI detection through human interaction. Our proof of concept investigates how the achievable accuracy varies with the quality of the user input. The results show that the accuracy of the ROI estimation has a minimal impact on the overall accuracy. Existing limitations can be addressed by other approaches presented.

AB - Augmented Reality (AR)-based programming approaches hold great promise for addressing the challenges of flexible automation by facilitating fast and intuitive programming processes. Pose estimation of novel objects enhances the program-ming experience by bridging the real and virtual environments. However, a prerequisite for pose estimation is to perform a 2D segmentation to determine the region of interest (ROI). In this work, we present an AR-based approach that enables point-and-click ROI detection through human interaction. Our proof of concept investigates how the achievable accuracy varies with the quality of the user input. The results show that the accuracy of the ROI estimation has a minimal impact on the overall accuracy. Existing limitations can be addressed by other approaches presented.

KW - augmented reality

KW - HMD

KW - human-robot collaboration

KW - intuitive programming

KW - pose estimation

UR - http://www.scopus.com/inward/record.url?scp=105004879704&partnerID=8YFLogxK

U2 - 10.1109/HRI61500.2025.10974140

DO - 10.1109/HRI61500.2025.10974140

M3 - Conference contribution

AN - SCOPUS:105004879704

SN - 979-8-3503-7894-8

T3 - ACM/IEEE International Conference on Human-Robot Interaction

SP - 1250

EP - 1254

BT - 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI)

T2 - 20th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2025

Y2 - 4 March 2025 through 6 March 2025

ER -

By the same author(s)