Deep Reinforcement Learning Based UAV for Indoor Navigation and Exploration in Unknown Environments

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Andreas Seel
  • Florian Kreutzjans
  • Benjamin Kuster
  • Malte Stonis
  • Ludger Overmeyer

Externe Organisationen

  • Institut für integrierte Produktion Hannover (IPH) gGmbH
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2022 8th International Conference on Control, Automation and Robotics
UntertitelICCAR 2022
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers Inc.
Seiten388-393
Seitenumfang6
ISBN (elektronisch)9781665481168
ISBN (Print)9781665481175
PublikationsstatusVeröffentlicht - 2022
Veranstaltung8th International Conference on Control, Automation and Robotics, ICCAR 2022 - Xiamen, China
Dauer: 8 Apr. 202210 Apr. 2022

Abstract

Factory planning can increase the productivity of manufacturing significantly, though the process is expensive when it comes to cost and time. In this paper, we propose an Unmanned Aerial Vehicle (UAV) framework that accelerates this process and decreases the costs. The framework consists of a UAV that is equipped with an IMU, a camera and a LiDAR sensor in order to navigate and explore unknown indoor environments. Thus, it is independent of GNSS and solely uses on-board sensors. The acquired data should enable a DRL agent to perform autonomous decision making, applying a reinforcement learning approach. We propose a simulation of this framework including several training and testing environments, that should be used for developing a DRL agent.

ASJC Scopus Sachgebiete

Zitieren

Deep Reinforcement Learning Based UAV for Indoor Navigation and Exploration in Unknown Environments. / Seel, Andreas; Kreutzjans, Florian; Kuster, Benjamin et al.
2022 8th International Conference on Control, Automation and Robotics: ICCAR 2022. Institute of Electrical and Electronics Engineers Inc., 2022. S. 388-393.

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Seel, A, Kreutzjans, F, Kuster, B, Stonis, M & Overmeyer, L 2022, Deep Reinforcement Learning Based UAV for Indoor Navigation and Exploration in Unknown Environments. in 2022 8th International Conference on Control, Automation and Robotics: ICCAR 2022. Institute of Electrical and Electronics Engineers Inc., S. 388-393, 8th International Conference on Control, Automation and Robotics, ICCAR 2022, Xiamen, China, 8 Apr. 2022. https://doi.org/10.1109/ICCAR55106.2022.9782602
Seel, A., Kreutzjans, F., Kuster, B., Stonis, M., & Overmeyer, L. (2022). Deep Reinforcement Learning Based UAV for Indoor Navigation and Exploration in Unknown Environments. In 2022 8th International Conference on Control, Automation and Robotics: ICCAR 2022 (S. 388-393). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCAR55106.2022.9782602
Seel A, Kreutzjans F, Kuster B, Stonis M, Overmeyer L. Deep Reinforcement Learning Based UAV for Indoor Navigation and Exploration in Unknown Environments. in 2022 8th International Conference on Control, Automation and Robotics: ICCAR 2022. Institute of Electrical and Electronics Engineers Inc. 2022. S. 388-393 doi: 10.1109/ICCAR55106.2022.9782602
Seel, Andreas ; Kreutzjans, Florian ; Kuster, Benjamin et al. / Deep Reinforcement Learning Based UAV for Indoor Navigation and Exploration in Unknown Environments. 2022 8th International Conference on Control, Automation and Robotics: ICCAR 2022. Institute of Electrical and Electronics Engineers Inc., 2022. S. 388-393
Download
@inproceedings{c524f6450d3e4dceaf611e01be0f9dad,
title = "Deep Reinforcement Learning Based UAV for Indoor Navigation and Exploration in Unknown Environments",
abstract = "Factory planning can increase the productivity of manufacturing significantly, though the process is expensive when it comes to cost and time. In this paper, we propose an Unmanned Aerial Vehicle (UAV) framework that accelerates this process and decreases the costs. The framework consists of a UAV that is equipped with an IMU, a camera and a LiDAR sensor in order to navigate and explore unknown indoor environments. Thus, it is independent of GNSS and solely uses on-board sensors. The acquired data should enable a DRL agent to perform autonomous decision making, applying a reinforcement learning approach. We propose a simulation of this framework including several training and testing environments, that should be used for developing a DRL agent.",
keywords = "autonomous exploration, autonomous navigation, Deep Reinforcement Learning, factory planning, GNSS-denied environment, UAV",
author = "Andreas Seel and Florian Kreutzjans and Benjamin Kuster and Malte Stonis and Ludger Overmeyer",
note = "Funding Information: ACKNOWLEDGMENT This work is a part of the IGF project 21395 N of the Research Association for Intralogistics, Materials Handling and Logistic Systems (IFL) and it was funded via the German Federation of Industrial Research Associations (AiF) in the program of Industrial Collective Research (IGF) by the Federal Ministry for Economic Affairs and Energy (BMWi) based on a decision of the German Bundestag.; 8th International Conference on Control, Automation and Robotics, ICCAR 2022 ; Conference date: 08-04-2022 Through 10-04-2022",
year = "2022",
doi = "10.1109/ICCAR55106.2022.9782602",
language = "English",
isbn = "9781665481175",
pages = "388--393",
booktitle = "2022 8th International Conference on Control, Automation and Robotics",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

Download

TY - GEN

T1 - Deep Reinforcement Learning Based UAV for Indoor Navigation and Exploration in Unknown Environments

AU - Seel, Andreas

AU - Kreutzjans, Florian

AU - Kuster, Benjamin

AU - Stonis, Malte

AU - Overmeyer, Ludger

N1 - Funding Information: ACKNOWLEDGMENT This work is a part of the IGF project 21395 N of the Research Association for Intralogistics, Materials Handling and Logistic Systems (IFL) and it was funded via the German Federation of Industrial Research Associations (AiF) in the program of Industrial Collective Research (IGF) by the Federal Ministry for Economic Affairs and Energy (BMWi) based on a decision of the German Bundestag.

PY - 2022

Y1 - 2022

N2 - Factory planning can increase the productivity of manufacturing significantly, though the process is expensive when it comes to cost and time. In this paper, we propose an Unmanned Aerial Vehicle (UAV) framework that accelerates this process and decreases the costs. The framework consists of a UAV that is equipped with an IMU, a camera and a LiDAR sensor in order to navigate and explore unknown indoor environments. Thus, it is independent of GNSS and solely uses on-board sensors. The acquired data should enable a DRL agent to perform autonomous decision making, applying a reinforcement learning approach. We propose a simulation of this framework including several training and testing environments, that should be used for developing a DRL agent.

AB - Factory planning can increase the productivity of manufacturing significantly, though the process is expensive when it comes to cost and time. In this paper, we propose an Unmanned Aerial Vehicle (UAV) framework that accelerates this process and decreases the costs. The framework consists of a UAV that is equipped with an IMU, a camera and a LiDAR sensor in order to navigate and explore unknown indoor environments. Thus, it is independent of GNSS and solely uses on-board sensors. The acquired data should enable a DRL agent to perform autonomous decision making, applying a reinforcement learning approach. We propose a simulation of this framework including several training and testing environments, that should be used for developing a DRL agent.

KW - autonomous exploration

KW - autonomous navigation

KW - Deep Reinforcement Learning

KW - factory planning

KW - GNSS-denied environment

KW - UAV

UR - http://www.scopus.com/inward/record.url?scp=85132542361&partnerID=8YFLogxK

U2 - 10.1109/ICCAR55106.2022.9782602

DO - 10.1109/ICCAR55106.2022.9782602

M3 - Conference contribution

AN - SCOPUS:85132542361

SN - 9781665481175

SP - 388

EP - 393

BT - 2022 8th International Conference on Control, Automation and Robotics

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 8th International Conference on Control, Automation and Robotics, ICCAR 2022

Y2 - 8 April 2022 through 10 April 2022

ER -