Integrating AI-Driven Robust Control Algorithm with 3D Hand Gesture Recognition to Track an Underactuated Quadrotor Unmanned Aerial Vehicle (QUAV)

Ibrahim Emad Al-Shayeb*, Ghulam E.Mustafa Abro, Fawad Salam Khan, Rozan Boudville, Ayman M. Abdallah

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The aviation sector has seen several modifications, most of which are connected to autopilot systems. In the current era of artificial intelligence (AI), robust control algorithms can be tuned for optimal accuracy by utilizing AI's power. To adjust the control system for controlling the drone, this publication suggests combining the Reinforcement Learning algorithm with the ability to recognize 3D hand gestures as input. This study uses Deep Deterministic Policy Gradient (DDPG) in conjunction with 3D hand gesture recognition to determine the optimal reward and transfer the processed input to proportional integral derivative (PID) control. This method demonstrated how an AI-powered control algorithm can enhance an underactuated quadrotor unmanned aerial vehicle's (UAV) ability to fly and hover. In addition to simulation data, the study includes hardware results that were verified with a DJI Tello Drone. When compared to a typical PID flight controller, the examination of the findings shows that the new design framework provides better accuracy and computing time. Six reward functions normalized between 0 and -4000, have been estimated for training episodes of 2500, 5000, 7500, and 10,000. The greatest observation, wherein the rewards are computed for maximum value, has been recorded on 2500 episodes.

Original languageEnglish
Title of host publication14th IEEE International Conference on Control System, Computing and Engineering, ICCSCE 2024 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages70-75
Number of pages6
ISBN (Electronic)9798350364507
DOIs
StatePublished - 2024
Event14th IEEE International Conference on Control System, Computing and Engineering, ICCSCE 2024 - Penang, Malaysia
Duration: 23 Aug 202424 Aug 2024

Publication series

Name14th IEEE International Conference on Control System, Computing and Engineering, ICCSCE 2024 - Proceedings

Conference

Conference14th IEEE International Conference on Control System, Computing and Engineering, ICCSCE 2024
Country/TerritoryMalaysia
CityPenang
Period23/08/2424/08/24

Bibliographical note

Publisher Copyright:
© 2024 IEEE.

Keywords

  • Quadrotors UAV
  • UAV control
  • deep reinforcement learning
  • hand gestures recognition
  • human-machine interface

ASJC Scopus subject areas

  • Information Systems
  • Information Systems and Management
  • Computational Mathematics
  • Health Informatics
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of 'Integrating AI-Driven Robust Control Algorithm with 3D Hand Gesture Recognition to Track an Underactuated Quadrotor Unmanned Aerial Vehicle (QUAV)'. Together they form a unique fingerprint.

Cite this