Gesture Recognition Intermediary Robot for Abnormality Detection in Human Activities

Salisu Wada Yahaya, Ahmad Lotfi, Mufti Mahmud, Pedro MacHado, Naoyuki Kubota

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

19 Scopus citations

Abstract

The world ageing population is increasing, giving rise to research targeted towards improving the quality of life and promoting the independent living of older adults. Detecting abnormalities in the daily activities of the older adults is relevant since abnormalities can be an early sign of health decline, prompting for the need for intervention. Current approaches to abnormality detection involve modelling the usual behavioural routine of the individual as a baseline and comparing subsequent behaviour to the baseline to detect abnormalities. This approach is prone to errors and not flexible since it does not take into account changes in human behavioural routine. Training is usually performed on pre-existing data making the abnormality detection model non-adaptive to new incoming data. An intermediary can be incorporated to enable model predictions to be communicated to humans for verification of the detected anomalies. This paper proposes a gesture recognition approach for facilitating interaction between humans and a robot intermediary. A model capable of recognising hand gestures corresponding to affirmations and denials is implemented. Preliminary evaluation shows that the proposed gesture recognition approach has the potential of being utilised in an assistive robot intermediary.

Original languageEnglish
Title of host publication2019 IEEE Symposium Series on Computational Intelligence, SSCI 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1415-1421
Number of pages7
ISBN (Electronic)9781728124858
DOIs
StatePublished - Dec 2019
Externally publishedYes

Publication series

Name2019 IEEE Symposium Series on Computational Intelligence, SSCI 2019

Bibliographical note

Publisher Copyright:
© 2019 IEEE.

Keywords

  • Activities of Daily Living (ADL)
  • Convolutional Neural Network (CNN)
  • You Only Look Once (YOLO)
  • abnormality detection
  • anomaly detection
  • assistive robot
  • gesture recognition

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Modeling and Simulation

Fingerprint

Dive into the research topics of 'Gesture Recognition Intermediary Robot for Abnormality Detection in Human Activities'. Together they form a unique fingerprint.

Cite this