An Efficient Attention-Based Strategy for Anomaly Detection in Surveillance Video

  • Sareer Ul Amin
  • , Yongjun Kim
  • , Irfan Sami
  • , Sangoh Park*
  • , Sanghyun Seo*
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

53 Scopus citations

Abstract

In the present technological world, surveillance cameras generate an immense amount of video data from various sources, making its scrutiny tough for computer vision specialists. It is difficult to search for anomalous events manually in these massive video records since they happen infrequently and with a low probability in real-world monitoring systems. Therefore, intelligent surveillance is a requirement of the modern day, as it enables the automatic identification of normal and aberrant behavior using artificial intelligence and computer vision technologies. In this article, we introduce an efficient Attention-based deep-learning approach for anomaly detection in surveillance video (ADSV). At the input of the ADSV, a shots boundary detection technique is used to segment prominent frames. Next, The Lightweight Convolution Neural Network (LWCNN) model receives the segmented frames to extract spatial and temporal information from the intermediate layer. Following that, spatial and temporal features are learned using Long Short-Term Memory (LSTM) cells and Attention Network from a series of frames for each anomalous activity in a sample. To detect motion and action, the LWCNN received chronologically sorted frames. Finally, the anomaly activity in the video is identified using the proposed trained ADSV model. Extensive experiments are conducted on complex and challenging benchmark datasets. In addition, the experimental results have been compared to state-of-the-art methodologies, and a significant improvement is attained, demonstrating the efficiency of our ADSV method.

Original languageEnglish
Pages (from-to)3939-3958
Number of pages20
JournalComputer Systems Science and Engineering
Volume46
Issue number3
DOIs
StatePublished - 2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2023 CRL Publishing. All rights reserved.

Keywords

  • Attention-based anomaly detection
  • attention model
  • computer vision
  • deep learning
  • smart surveillance system
  • video shots segmentation
  • video surveillance
  • violence detection

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'An Efficient Attention-Based Strategy for Anomaly Detection in Surveillance Video'. Together they form a unique fingerprint.

Cite this