Incremental convolutional transformer for baggage threat detection

Taimur Hassan, Bilal Hassan, Muhammad Owais, Divya Velayudhan, Jorge Dias, Mohammed Ghazal, Naoufel Werghi

Research output: Contribution to journalArticlepeer-review

Abstract

Detecting cluttered and overlapping contraband items from baggage scans is one of the most challenging tasks, even for human experts. Recently, considerable literature has grown up around the theme of deep learning-based X-ray screening for localizing contraband data. However, the existing threat detection systems are still vulnerable to high occlusion, clutter, and concealment. Furthermore, they require exhaustive training routines on large-scale and well-annotated data in order to produce accurate results. To overcome the above-mentioned limitations, this paper presents a novel convolutional transformer system that recognizes different overlapping instances of prohibited objects in complex baggage X-ray scans via a distillation-driven incremental instance segmentation scheme. Furthermore, unlike its competitors, the proposed framework allows an incremental integration of new item instances while avoiding costly training routines. In addition to this, the proposed framework also outperforms state-of-the-art approaches by achieving a mean average precision score of 0.7896, 0.5974, and 0.7569 on publicly available GDXray, SIXray, and OPIXray datasets for detecting concealed and cluttered baggage threats.

Original languageBritish English
Article number110493
JournalPattern Recognition
Volume153
DOIs
StatePublished - Sep 2024

Keywords

  • Catastrophic forgetting
  • Incremental instance segmentation
  • Incremental learning
  • Knowledge distillation
  • Threat detection
  • Transformers
  • X-ray imagery

Fingerprint

Dive into the research topics of 'Incremental convolutional transformer for baggage threat detection'. Together they form a unique fingerprint.

Cite this