TY - JOUR
T1 - Multiplex Cellular Communities in Multi-Gigapixel Colorectal Cancer Histology Images for Tissue Phenotyping
AU - Javed, Sajid
AU - Mahmood, Arif
AU - Werghi, Naoufel
AU - Benes, Ksenija
AU - Rajpoot, Nasir
N1 - Funding Information:
Manuscript received November 19, 2019; revised July 3, 2020 and August 25, 2020; accepted September 9, 2020. Date of publication September 23, 2020; date of current version September 30, 2020. This work was supported by the Khalifa University of Science and Technology under Award RC1-2018-KUCARS. The work of Nasir Rajpoot was supported in part by the U.K. Medical Research Council under Grant MR/P015476/1, in part by the Alan Turing Institute under Grant EP/N510129/1, in part by the Royal Society Wolfson Merit Award under Grant WM170013, and in part by the PathLAKE Digital Pathology Consortium, which is funded from the Data to Early Diagnosis and Precision Medicine strand of the Government’s Industrial Strategy Challenge Fund, managed and delivered by the U.K. Research and Innovation (UKRI). The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Charith Abhayaratne. (Corresponding author: Naoufel Werghi.) Sajid Javed and Naoufel Werghi are with the Department of Electrical and Computer Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates, and also with the KUCARS Center, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates (e-mail: [email protected]; [email protected]).
Publisher Copyright:
© 1992-2012 IEEE.
PY - 2020
Y1 - 2020
N2 - In computational pathology, automated tissue phenotyping in cancer histology images is a fundamental tool for profiling tumor microenvironments. Current tissue phenotyping methods use features derived from image patches which may not carry biological significance. In this work, we propose a novel multiplex cellular community-based algorithm for tissue phenotyping integrating cell-level features within a graph-based hierarchical framework. We demonstrate that such integration offers better performance compared to prior deep learning and texture-based methods as well as to cellular community based methods using uniplex networks. To this end, we construct cell-level graphs using texture, alpha diversity and multi-resolution deep features. Using these graphs, we compute cellular connectivity features which are then employed for the construction of a patch-level multiplex network. Over this network, we compute multiplex cellular communities using a novel objective function. The proposed objective function computes a low-dimensional subspace from each cellular network and subsequently seeks a common low-dimensional subspace using the Grassmann manifold. We evaluate our proposed algorithm on three publicly available datasets for tissue phenotyping, demonstrating a significant improvement over existing state-of-the-art methods.
AB - In computational pathology, automated tissue phenotyping in cancer histology images is a fundamental tool for profiling tumor microenvironments. Current tissue phenotyping methods use features derived from image patches which may not carry biological significance. In this work, we propose a novel multiplex cellular community-based algorithm for tissue phenotyping integrating cell-level features within a graph-based hierarchical framework. We demonstrate that such integration offers better performance compared to prior deep learning and texture-based methods as well as to cellular community based methods using uniplex networks. To this end, we construct cell-level graphs using texture, alpha diversity and multi-resolution deep features. Using these graphs, we compute cellular connectivity features which are then employed for the construction of a patch-level multiplex network. Over this network, we compute multiplex cellular communities using a novel objective function. The proposed objective function computes a low-dimensional subspace from each cellular network and subsequently seeks a common low-dimensional subspace using the Grassmann manifold. We evaluate our proposed algorithm on three publicly available datasets for tissue phenotyping, demonstrating a significant improvement over existing state-of-the-art methods.
KW - Cellular community detection
KW - colon cancer
KW - computational pathology
KW - tissue phenotyping
UR - http://www.scopus.com/inward/record.url?scp=85092589483&partnerID=8YFLogxK
U2 - 10.1109/TIP.2020.3023795
DO - 10.1109/TIP.2020.3023795
M3 - Article
AN - SCOPUS:85092589483
SN - 1057-7149
VL - 29
SP - 9204
EP - 9219
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
M1 - 9204851
ER -