Skip to main navigation Skip to search Skip to main content

From Posture to Performance: Continuous Cognitive Load Estimation of Drivers Using Multi-Modal Anatomical Keypoints

  • Golam Sakaline*
  • , Syed Md Sadman Rafid
  • , Moshiur Ahmed
  • , Ahmet Kolus
  • *Corresponding author for this work

Research output: Contribution to journal › Conference article › peer-review

Abstract

Driver distraction and cognitive overload are significant contributors to road accidents; however, most vision-based driver monitoring systems focus on classifying observable behaviors rather than estimating underlying cognitive workload. This study presents a non-contact, interpretable framework for continuous cognitive load (CL) estimation that relies solely on 2D pose, face, and hand keypoints extracted from realistic driving images. Using the Multi-Class Driver Behavior Image Dataset collected in Ashulia, Dhaka (2024), five driver behavior categories are mapped to normalized CL scores (ranging from 0 to 1), reframing the problem as a regression task to capture the continuous spectrum of cognitive effort. MediaPipe is utilized to extract body posture, head orientation, and hand-movement keypoints, which are then normalized and combined into a unified feature vector. The proposed Multi-task Learning (MTL) architecture, built upon a shared Multi-layer perceptron (MLP) backbone, simultaneously predicts discrete driver behavior and continuous CL using two task-specific output heads. The results show competitive predictive performances with Pearson of 0.58, MSE of 0.052, and R² = 0.34, too, meaning that predicted and ground-truth CL scores are very close. Analysis of the importance of features shows that the biggest predictors of cognitive effort are cues based on body position such as torso lean, head tilt, and hand placement. It generates continuous load distributions despite being trained with discrete behavioral labels while maintaining within-class variability. This work provides the first example of a privacy-preserving, low-cost and explainable alternative to intrusive physiological sensing by combining behavioral action recognition with continuous cognitive state estimation. To enable immediate integration into Advanced Driver Assistance Systems (ADAS), driver monitoring modules, and pipelines for detecting the fatigued or distracted driver, the method is compact and operates in real-time.

Original languageEnglish
Pages (from-to)852-859
Number of pages8
JournalTransportation Research Procedia
Volume97
DOIs
StatePublished - 2026
Event13th International Conference on Transport Survey Methods, 2026 - Danang, Viet Nam
Duration: 30 Mar 2025 → 4 Apr 2025

Bibliographical note

Publisher Copyright:
Copyright © 2026. Published by Elsevier B.V.

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being

Keywords

  • advanced driver assistance systems
  • cognitive load
  • driver behavior
  • multi-task learning

ASJC Scopus subject areas

  • Transportation

Fingerprint

Dive into the research topics of 'From Posture to Performance: Continuous Cognitive Load Estimation of Drivers Using Multi-Modal Anatomical Keypoints'. Together they form a unique fingerprint.

Cite this