TY - GEN
T1 - Hyperdimensional Computing Versus Convolutional Neural Network
T2 - 2023 International Conference on Microelectronics, ICM 2023
AU - Hassan, Eman
AU - Bettayeb, Meriem
AU - Mohammad, Baker
AU - Zweiri, Yahya
AU - Saleh, Hani
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - The interest in brain-inspired computing architectures has been growing, particularly in the context of edge devices with constrained resources for executing cognitive functions. One such approach is hyperdimensional computing (HDC), a novel concept that draws inspiration from the large representation of human neuronal activity. HDC has demonstrated effectiveness in one-dimensional tasks, like text identification and activity recognition, offering advantages in power consumption and response time over convolutional neural networks (CNNs). This paper compares HDC and CNN regarding architecture, accuracy, and hardware complexity, explicitly focusing on image classification tasks. Our findings indicate that CNNs generally outperform HDC in two-dimensional tasks but require significantly more computational resources. In contrast, HDC offers adequate results using just 16% of the data needed for training. Additionally, experiments conducted using a Raspberry Pi 4 show that HDC can enhance inference speed and energy efficiency by approximately 2.5 times relative to CNNs.
AB - The interest in brain-inspired computing architectures has been growing, particularly in the context of edge devices with constrained resources for executing cognitive functions. One such approach is hyperdimensional computing (HDC), a novel concept that draws inspiration from the large representation of human neuronal activity. HDC has demonstrated effectiveness in one-dimensional tasks, like text identification and activity recognition, offering advantages in power consumption and response time over convolutional neural networks (CNNs). This paper compares HDC and CNN regarding architecture, accuracy, and hardware complexity, explicitly focusing on image classification tasks. Our findings indicate that CNNs generally outperform HDC in two-dimensional tasks but require significantly more computational resources. In contrast, HDC offers adequate results using just 16% of the data needed for training. Additionally, experiments conducted using a Raspberry Pi 4 show that HDC can enhance inference speed and energy efficiency by approximately 2.5 times relative to CNNs.
KW - Convolutional neural networks
KW - Encoding and learning
KW - Hyperdimensional computing
KW - Image classification
UR - http://www.scopus.com/inward/record.url?scp=85183325330&partnerID=8YFLogxK
U2 - 10.1109/ICM60448.2023.10378944
DO - 10.1109/ICM60448.2023.10378944
M3 - Conference contribution
AN - SCOPUS:85183325330
T3 - Proceedings of the International Conference on Microelectronics, ICM
SP - 228
EP - 233
BT - 2023 International Conference on Microelectronics, ICM 2023
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 17 November 2023 through 20 November 2023
ER -