Sanchez-Lopez, Jose-Luis (SnT, University of Luxembourg), Castillo-Lopez, Manuel (University of Luxembourg), Voos, Holger (University of Luxembourg)

Semantic Situation Awareness of Ellipse Shapes Via Deep Learning for Multirotor Aerial Robots with a 2D LIDAR

Scheduled for presentation during the Regular Session "Sensor Fusion" (ThC1), Thursday, September 3, 2020, 18:20−18:40, Macedonia Hall

2020 International Conference on Unmanned Aircraft Systems (ICUAS), September 1-4, 2020 (Postponed from June 9-12, 2020), Athens, Greece

This information is tentative and subject to change. Compiled on April 25, 2024

Abstract

In this work, we present a semantic situation awareness system for multirotor aerial robots equipped with a 2D LIDAR sensor, focusing on the understanding of the environment, provided to have a drift-free precise localization of the robot (e.g. given by GNSS/INS or motion capture system). Our algorithm generates in real-time a semantic map of the objects of the environment as a list of ellipses represented by their radii, nd their pose and velocity, both in world coordinates. Two different Convolutional Neural Network (CNN) architectures are proposed and trained using an artificially generated dataset and a custom loss function, to detect ellipses in a segmented (i.e. with one single object) LIDAR measurement. In cascade, a specifically designed indirect-EKF estimates the ellipses based semantic map in world coordinates, as well as their velocity. We have quantitative and qualitatively evaluated the performance of our proposed situation awareness system. Two sets of Software-In-The-Loop simulations using CoppeliaSim with one and multiple static and moving cylindrical objects are used to evaluate the accuracy and performance of our algorithm. In addition, we have demonstrated the robustness of our proposed algorithm when handling real environments thanks to real laboratory experiments with non-cylindrical static (i.e. a barrel) objects and moving persons.