TY - JOUR
T1 - Tactile sensing using machine learning-driven electrical impedance tomography
AU - Husain, Zainab
AU - Madjid, Nadya Abdel
AU - Liatsis, Panos
N1 - Funding Information:
Nadya Abdel Madjid received the bachelor’s degree in applied mathematics and computer science from Lomonosov Moscow State University and the M.Sc. degree through the research and teaching assistant scholarship from the Khalifa University of Science and Technology in 2020. She is currently working as an Independent Researcher focusing on using deep learning for developing enhanced recognition algorithms for EIT-tactile sensors.
Funding Information:
Manuscript received November 22, 2020; revised January 18, 2021; accepted January 22, 2021. Date of publication January 27, 2021; date of current version April 16, 2021. This work was supported by the Khalifa University of Science and Technology under Grant CIRA-2018-59. The associate editor coordinating the review of this article and approving it for publication was Dr. Julio C. Rodriguez-Quiñonez.(Corresponding author: Panos Liatsis.) The authors are with the Department of Electrical Engineering and Computer Science, Khalifa University of Science and Technology, Abu Dhabi, UAE (e-mail: [email protected]; [email protected]; [email protected]). Digital Object Identifier 10.1109/JSEN.2021.3054870 Fig. 1. An overview of the application of EIT in tactile sensing and how the problem of object recognition is reduced to a shape recognition problem.
Publisher Copyright:
© 2001-2012 IEEE.
PY - 2021/5/15
Y1 - 2021/5/15
N2 - Electrical Impedance Tomography (EIT) tactile sensors have limited success in equipping robots with tactile sensing capabilities due to the low spatial resolution of the resulting tactile images and the presence of image artifacts. To address these limitations, we propose a modular framework for invariant recognition of objects, within the context of an EIT artificial skin sensor. Three interconnected problems, i.e., EIT image reconstruction, segmentation and object recognition, are tackled in this work with the aid of machine learning. A novel conductivity surface decomposition approach, based on low order bivariate polynomials and RBF networks is introduced for the efficient solution of the EIT inverse problem. Next, segmentation of the reconstructed images is performed using a convolutional neural network and transfer learning. Finally, a subspace KNN ensemble classifier is trained on the set of object descriptors extracted from the segmented inhomogeneities to classify the objects. The proposed framework provides an accuracy of 97.5% on unseen data.
AB - Electrical Impedance Tomography (EIT) tactile sensors have limited success in equipping robots with tactile sensing capabilities due to the low spatial resolution of the resulting tactile images and the presence of image artifacts. To address these limitations, we propose a modular framework for invariant recognition of objects, within the context of an EIT artificial skin sensor. Three interconnected problems, i.e., EIT image reconstruction, segmentation and object recognition, are tackled in this work with the aid of machine learning. A novel conductivity surface decomposition approach, based on low order bivariate polynomials and RBF networks is introduced for the efficient solution of the EIT inverse problem. Next, segmentation of the reconstructed images is performed using a convolutional neural network and transfer learning. Finally, a subspace KNN ensemble classifier is trained on the set of object descriptors extracted from the segmented inhomogeneities to classify the objects. The proposed framework provides an accuracy of 97.5% on unseen data.
KW - Electrical impedance tomography
KW - Image reconstruction
KW - Object recognition
KW - Segmentation
KW - Tactile sensing
UR - https://www.scopus.com/pages/publications/85100494103
U2 - 10.1109/JSEN.2021.3054870
DO - 10.1109/JSEN.2021.3054870
M3 - Article
AN - SCOPUS:85100494103
SN - 1530-437X
VL - 21
SP - 11628
EP - 11642
JO - IEEE Sensors Journal
JF - IEEE Sensors Journal
IS - 10
M1 - 9336698
ER -