TY - JOUR
T1 - Incremental convolutional transformer for baggage threat detection
AU - Hassan, Taimur
AU - Hassan, Bilal
AU - Owais, Muhammad
AU - Velayudhan, Divya
AU - Dias, Jorge
AU - Ghazal, Mohammed
AU - Werghi, Naoufel
N1 - Publisher Copyright:
© 2024 Elsevier Ltd
PY - 2024/9
Y1 - 2024/9
N2 - Detecting cluttered and overlapping contraband items from baggage scans is one of the most challenging tasks, even for human experts. Recently, considerable literature has grown up around the theme of deep learning-based X-ray screening for localizing contraband data. However, the existing threat detection systems are still vulnerable to high occlusion, clutter, and concealment. Furthermore, they require exhaustive training routines on large-scale and well-annotated data in order to produce accurate results. To overcome the above-mentioned limitations, this paper presents a novel convolutional transformer system that recognizes different overlapping instances of prohibited objects in complex baggage X-ray scans via a distillation-driven incremental instance segmentation scheme. Furthermore, unlike its competitors, the proposed framework allows an incremental integration of new item instances while avoiding costly training routines. In addition to this, the proposed framework also outperforms state-of-the-art approaches by achieving a mean average precision score of 0.7896, 0.5974, and 0.7569 on publicly available GDXray, SIXray, and OPIXray datasets for detecting concealed and cluttered baggage threats.
AB - Detecting cluttered and overlapping contraband items from baggage scans is one of the most challenging tasks, even for human experts. Recently, considerable literature has grown up around the theme of deep learning-based X-ray screening for localizing contraband data. However, the existing threat detection systems are still vulnerable to high occlusion, clutter, and concealment. Furthermore, they require exhaustive training routines on large-scale and well-annotated data in order to produce accurate results. To overcome the above-mentioned limitations, this paper presents a novel convolutional transformer system that recognizes different overlapping instances of prohibited objects in complex baggage X-ray scans via a distillation-driven incremental instance segmentation scheme. Furthermore, unlike its competitors, the proposed framework allows an incremental integration of new item instances while avoiding costly training routines. In addition to this, the proposed framework also outperforms state-of-the-art approaches by achieving a mean average precision score of 0.7896, 0.5974, and 0.7569 on publicly available GDXray, SIXray, and OPIXray datasets for detecting concealed and cluttered baggage threats.
KW - Catastrophic forgetting
KW - Incremental instance segmentation
KW - Incremental learning
KW - Knowledge distillation
KW - Threat detection
KW - Transformers
KW - X-ray imagery
UR - http://www.scopus.com/inward/record.url?scp=85191377271&partnerID=8YFLogxK
U2 - 10.1016/j.patcog.2024.110493
DO - 10.1016/j.patcog.2024.110493
M3 - Article
AN - SCOPUS:85191377271
SN - 0031-3203
VL - 153
JO - Pattern Recognition
JF - Pattern Recognition
M1 - 110493
ER -