Srivastava, Raunak (Indian Institute Of Technology Bombay), Lima, Rolif (TCS Innovation labs), Das, Kaushik (TATA Consultancy Service), Maity, Arnab (Indian Institute of Technology Bombay)

Least Square Policy Iteration for IBVS Based Dynamic Target Tracking

Scheduled for presentation during the Regular Session "Airspace Control" (ThC4), Thursday, June 13, 2019, 17:00−17:20, Savannah

2020 International Conference on Unmanned Aircraft Systems (ICUAS), June 11-14, 2019, Athens, Greece

This information is tentative and subject to change. Compiled on April 25, 2024

Abstract

This paper delves into the problem of tracking a maneuvering target based on only vision based feedback namely Image Based Visual Servoing (IBVS). In the absence of a GPS or any other external sensor, vision proves to be a valuable source of information about the environment. However it is difficult to perform the tracking using only a monocular vision due to the absence of depth measurement. This restricts the use of traditional IBVS methods as they rely on the interaction matrix which is sensitive to various camera parameters and depth estimate. We thus solve this problem through a learning based approach and model it as Markov decision process, on which we apply a Reinforcement Learning technique. Least Square Policy Iteration (LSPI) learns the optimal control policies required to keep following the target drone while maintaining a fixed distance from it. The performance of the proposed algorithm is tested and simulated in Gazebo environment.