A Real-Time Deep Learning-based Smart Surveillance Using Fog Computing: A Complete Architecture

M. Fasial Nurnoby, Tarek Helmy*

*Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

1 Scopus citations


Fog computing offers low-latency and real-time big-data processing capabilities closer to the network edge. This particular benefit addresses the main bottleneck in a centralized cloud framework, which is, it cannot process latency-sensitive large video frames generated from the Internet of Things-based video surveillance cameras in real-time. Besides, the recent advancements in the computer vision field offer many state-of-the-art image processing capabilities that can be utilized for real-time surveillance data processing. Deploying those processing powers at several fog computing layers can bring novel solutions for computer vision-based real-time security solutions. This paper proposes a deep learning-based framework for smart video surveillance that can process the real-time frames on two consecutive fog layers, one for action recognition and the other for criminal threat-based response generation. The proposed architecture consists of three major modules. The first module is responsible for capturing surveillance videos by deploying RaspberryPi cameras in a distributed network. The second module is responsible for action recognition using a deep learning-based model installed inside NVIDIA Jetson Nano-devices placed on two fog layers. Finally, the security response is generated and broadcast to the law-enforcement agency. To evaluate the proposed model, experiments on semantic segmentation-based scene object recognition were run. The experimental results came up with a suitable recognition model that can be deployed in the fog layers of our proposed framework.

Original languageEnglish
Pages (from-to)1102-1111
Number of pages10
JournalProcedia Computer Science
StatePublished - 2022
Event2022 International Conference on Machine Learning and Data Engineering, ICMLDE 2022 - Dehradun, India
Duration: 7 Sep 20228 Sep 2022

Bibliographical note

Publisher Copyright:
© 2023 The Authors. Published by Elsevier B.V.


  • Computer Vision
  • Deep Learning
  • Fog-Computing
  • Internet of Things
  • Smart Video Surveillance

ASJC Scopus subject areas

  • General Computer Science


Dive into the research topics of 'A Real-Time Deep Learning-based Smart Surveillance Using Fog Computing: A Complete Architecture'. Together they form a unique fingerprint.

Cite this