Human Joint Skeleton Tracking Using Multiple Kinect Azure

Azhar Aulia Saputra; Adnan Rachmat Anom Besari; Naoyuki Kubota

doi:10.1109/IES55876.2022.9888532

Human Joint Skeleton Tracking Using Multiple Kinect Azure

Azhar Aulia Saputra
, Adnan Rachmat Anom Besari
, Naoyuki Kubota

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

20 Scopus citations

Abstract

Development of human skeleton tracking requires high accuracy with affordable installation to enlarge their applicability. This paper proposes human skeleton tracking using multiple cameras to minimize occlusion. We combined multiple human tracking modules from Azure based on ONNX Runtime. Each module uses passive infrared as the human segmentation and recognition process and depth information to transform to the 3D position. Each module's output skeleton data is separated into six parts: right-upper limb, left-upper limb, right-lower limb, left-lower limb, head, and torso. Then those part is compared and combined based on the confidence evaluation based on the occlusion probabilistic. Furthermore, 35 joint skeleton angles are also generated based on the anatomy of the human musculoskeletal model. The effectiveness of the proposed model has been validated from the comparison with related work and some applications of human muscle activity monitoring.

Original language	English
Title of host publication	IES 2022 - 2022 International Electronics Symposium
Subtitle of host publication	Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding
Editors	Andhik Ampuh Yunanto, Yanuar Risah Prayogi, Putu Agus Mahadi Putra, Hendhi Hermawan, Nailussa'ada Nailussa'ada, Maretha Ruswiansari, Mohamad Ridwan, Farida Gamar, Afifah Dwi Ramadhani, Weny Mistarika Rahmawati, Muhammad Rizani Rusli
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	430-435
Number of pages	6
ISBN (Electronic)	9781665489713
DOIs	https://doi.org/10.1109/IES55876.2022.9888532
State	Published - 2022
Externally published	Yes
Event	24th International Electronics Symposium, IES 2022 - Surabaya, Indonesia Duration: 9 Aug 2022 → 11 Aug 2022

Publication series

Name	IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding

Conference

Conference	24th International Electronics Symposium, IES 2022
Country/Territory	Indonesia
City	Surabaya
Period	9/08/22 → 11/08/22

Bibliographical note

Publisher Copyright:
© 2022 IEEE.

Keywords

Human skeleton tracking
Kinect Azure DK
Multiple camera integration

ASJC Scopus subject areas

Energy Engineering and Power Technology
Renewable Energy, Sustainability and the Environment
Electrical and Electronic Engineering
Global and Planetary Change
Control and Optimization

Access to Document

10.1109/IES55876.2022.9888532

Cite this

Saputra, A. A., Besari, A. R. A., & Kubota, N. (2022). Human Joint Skeleton Tracking Using Multiple Kinect Azure. In A. A. Yunanto, Y. R. Prayogi, P. A. M. Putra, H. Hermawan, N. Nailussa'ada, M. Ruswiansari, M. Ridwan, F. Gamar, A. D. Ramadhani, W. M. Rahmawati, & M. R. Rusli (Eds.), IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding (pp. 430-435). (IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IES55876.2022.9888532

Saputra, Azhar Aulia ; Besari, Adnan Rachmat Anom ; Kubota, Naoyuki. / Human Joint Skeleton Tracking Using Multiple Kinect Azure. IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding. editor / Andhik Ampuh Yunanto ; Yanuar Risah Prayogi ; Putu Agus Mahadi Putra ; Hendhi Hermawan ; Nailussa'ada Nailussa'ada ; Maretha Ruswiansari ; Mohamad Ridwan ; Farida Gamar ; Afifah Dwi Ramadhani ; Weny Mistarika Rahmawati ; Muhammad Rizani Rusli. Institute of Electrical and Electronics Engineers Inc., 2022. pp. 430-435 (IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding).

@inproceedings{909b2a0e74a24acf8ca977ea49bff067,

title = "Human Joint Skeleton Tracking Using Multiple Kinect Azure",

abstract = "Development of human skeleton tracking requires high accuracy with affordable installation to enlarge their applicability. This paper proposes human skeleton tracking using multiple cameras to minimize occlusion. We combined multiple human tracking modules from Azure based on ONNX Runtime. Each module uses passive infrared as the human segmentation and recognition process and depth information to transform to the 3D position. Each module's output skeleton data is separated into six parts: right-upper limb, left-upper limb, right-lower limb, left-lower limb, head, and torso. Then those part is compared and combined based on the confidence evaluation based on the occlusion probabilistic. Furthermore, 35 joint skeleton angles are also generated based on the anatomy of the human musculoskeletal model. The effectiveness of the proposed model has been validated from the comparison with related work and some applications of human muscle activity monitoring.",

keywords = "Human skeleton tracking, Kinect Azure DK, Multiple camera integration",

author = "Saputra, \{Azhar Aulia\} and Besari, \{Adnan Rachmat Anom\} and Naoyuki Kubota",

note = "Publisher Copyright: {\textcopyright} 2022 IEEE.; 24th International Electronics Symposium, IES 2022 ; Conference date: 09-08-2022 Through 11-08-2022",

year = "2022",

doi = "10.1109/IES55876.2022.9888532",

language = "English",

series = "IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "430--435",

editor = "Yunanto, \{Andhik Ampuh\} and Prayogi, \{Yanuar Risah\} and Putra, \{Putu Agus Mahadi\} and Hendhi Hermawan and Nailussa'ada Nailussa'ada and Maretha Ruswiansari and Mohamad Ridwan and Farida Gamar and Ramadhani, \{Afifah Dwi\} and Rahmawati, \{Weny Mistarika\} and Rusli, \{Muhammad Rizani\}",

booktitle = "IES 2022 - 2022 International Electronics Symposium",

address = "United States",

}

Saputra, AA, Besari, ARA & Kubota, N 2022, Human Joint Skeleton Tracking Using Multiple Kinect Azure. in AA Yunanto, YR Prayogi, PAM Putra, H Hermawan, N Nailussa'ada, M Ruswiansari, M Ridwan, F Gamar, AD Ramadhani, WM Rahmawati & MR Rusli (eds), IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding. IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding, Institute of Electrical and Electronics Engineers Inc., pp. 430-435, 24th International Electronics Symposium, IES 2022, Surabaya, Indonesia, 9/08/22. https://doi.org/10.1109/IES55876.2022.9888532

Human Joint Skeleton Tracking Using Multiple Kinect Azure. / Saputra, Azhar Aulia; Besari, Adnan Rachmat Anom; Kubota, Naoyuki.
IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding. ed. / Andhik Ampuh Yunanto; Yanuar Risah Prayogi; Putu Agus Mahadi Putra; Hendhi Hermawan; Nailussa'ada Nailussa'ada; Maretha Ruswiansari; Mohamad Ridwan; Farida Gamar; Afifah Dwi Ramadhani; Weny Mistarika Rahmawati; Muhammad Rizani Rusli. Institute of Electrical and Electronics Engineers Inc., 2022. p. 430-435 (IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Human Joint Skeleton Tracking Using Multiple Kinect Azure

AU - Saputra, Azhar Aulia

AU - Besari, Adnan Rachmat Anom

AU - Kubota, Naoyuki

PY - 2022

Y1 - 2022

N2 - Development of human skeleton tracking requires high accuracy with affordable installation to enlarge their applicability. This paper proposes human skeleton tracking using multiple cameras to minimize occlusion. We combined multiple human tracking modules from Azure based on ONNX Runtime. Each module uses passive infrared as the human segmentation and recognition process and depth information to transform to the 3D position. Each module's output skeleton data is separated into six parts: right-upper limb, left-upper limb, right-lower limb, left-lower limb, head, and torso. Then those part is compared and combined based on the confidence evaluation based on the occlusion probabilistic. Furthermore, 35 joint skeleton angles are also generated based on the anatomy of the human musculoskeletal model. The effectiveness of the proposed model has been validated from the comparison with related work and some applications of human muscle activity monitoring.

AB - Development of human skeleton tracking requires high accuracy with affordable installation to enlarge their applicability. This paper proposes human skeleton tracking using multiple cameras to minimize occlusion. We combined multiple human tracking modules from Azure based on ONNX Runtime. Each module uses passive infrared as the human segmentation and recognition process and depth information to transform to the 3D position. Each module's output skeleton data is separated into six parts: right-upper limb, left-upper limb, right-lower limb, left-lower limb, head, and torso. Then those part is compared and combined based on the confidence evaluation based on the occlusion probabilistic. Furthermore, 35 joint skeleton angles are also generated based on the anatomy of the human musculoskeletal model. The effectiveness of the proposed model has been validated from the comparison with related work and some applications of human muscle activity monitoring.

KW - Human skeleton tracking

KW - Kinect Azure DK

KW - Multiple camera integration

UR - https://www.scopus.com/pages/publications/85139655872

U2 - 10.1109/IES55876.2022.9888532

DO - 10.1109/IES55876.2022.9888532

M3 - Conference contribution

AN - SCOPUS:85139655872

T3 - IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding

SP - 430

EP - 435

BT - IES 2022 - 2022 International Electronics Symposium

A2 - Yunanto, Andhik Ampuh

A2 - Prayogi, Yanuar Risah

A2 - Putra, Putu Agus Mahadi

A2 - Hermawan, Hendhi

A2 - Nailussa'ada, Nailussa'ada

A2 - Ruswiansari, Maretha

A2 - Ridwan, Mohamad

A2 - Gamar, Farida

A2 - Ramadhani, Afifah Dwi

A2 - Rahmawati, Weny Mistarika

A2 - Rusli, Muhammad Rizani

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 24th International Electronics Symposium, IES 2022

Y2 - 9 August 2022 through 11 August 2022

ER -

Saputra AA, Besari ARA, Kubota N. Human Joint Skeleton Tracking Using Multiple Kinect Azure. In Yunanto AA, Prayogi YR, Putra PAM, Hermawan H, Nailussa'ada N, Ruswiansari M, Ridwan M, Gamar F, Ramadhani AD, Rahmawati WM, Rusli MR, editors, IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding. Institute of Electrical and Electronics Engineers Inc. 2022. p. 430-435. (IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding). doi: 10.1109/IES55876.2022.9888532

Human Joint Skeleton Tracking Using Multiple Kinect Azure

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Fingerprint

Cite this