Park, On (Cranfield University), Shin, Hyo-Sang (Cranfield University), Tsourdos, Antonios (Cranfield University)

Linear Quadratic Tracker with Integrator Using Integral Reinforcement Learning

Scheduled for presentation during the Regular Session "Control Architectures I" (MoD12T2), Monday, November 25, 2019, 10:10−10:30, Room T2

2019 Workshop on Research, Education and Development of Unmanned Aerial Systems (RED UAS), November 25-27, 2019, Cranfield University, Cranfield, UK

This information is tentative and subject to change. Compiled on April 24, 2024

Abstract

This paper describes a Reinforcement Learning (RL) application using Linear Quadratic Regulator (LQR) based tracking controller, which is augmented with a tracking error term. In order to deal with the steady-state errors, Linear Quadratic Tracker with Integrator (LQTI) is designed by adding an integration term of the tracking error in the state variable. Based on the LQTI, an online learning using the Integral Reinforcement Learning (IRL) is applied for the tracking problem to find the optimal control on the partially unknown continuous-time systems by regulating the augmented state variable. The optimal control solution and the performance of the method are verified through numerical simulation on two applications.