Temporal Fusion Based Mutli-scale Semantic Segmentation for Detecting Concealed Baggage Threats

Muhammed Shafay, Taimur Hassan, Ernesto Damiani, Naoufel Werghi

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

13 Scopus citations

Abstract

Detection of illegal and threatening items in bag-gage is one of the utmost security concern nowadays. Even for experienced security personnel, manual detection is a time-consuming and stressful task.Many academics have created automated frameworks for detecting suspicious and contraband data from X-ray scans of luggage. However, to our knowledge, no framework exists that utilizes temporal baggage X-ray imagery to effectively screen highly concealed and occluded objects which are barely visible even to the naked eye. To address this, we present a novel temporal fusion driven multi-scale residual fashioned encoder-decoder that takes series of consecutive scans as input and fuses them to generate distinct feature representations of the suspicious and non-suspicious baggage content, leading towards a more accurate extraction of the contraband data. The proposed methodology has been thoroughly tested using the publicly accessible GDXray dataset, which is the only dataset containing temporally linked grayscale X-ray scans showcasing extremely concealed contraband data. The proposed framework outperforms its competitors on the GDXray dataset on various metrics.

Original languageBritish English
Title of host publication2021 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages232-237
Number of pages6
ISBN (Electronic)9781665442077
DOIs
StatePublished - 2021
Event2021 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2021 - Melbourne, Australia
Duration: 17 Oct 202120 Oct 2021

Publication series

NameConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
ISSN (Print)1062-922X

Conference

Conference2021 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2021
Country/TerritoryAustralia
CityMelbourne
Period17/10/2120/10/21

Keywords

  • Baggage Screening
  • Convolutional Neural Network
  • Image analysis
  • Structure Tensor
  • X-ray images

Fingerprint

Dive into the research topics of 'Temporal Fusion Based Mutli-scale Semantic Segmentation for Detecting Concealed Baggage Threats'. Together they form a unique fingerprint.

Cite this