SpatialHD: Spatial Transformer Fused with Hyperdimensional Computing for AI Applications

Meriem Bettayeb, Eman Hassan, Baker Mohammad, Hani Saleh

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    2 Scopus citations

    Abstract

    Brain-inspired computing methods have shown remarkable efficiency and robustness compared to deep neural networks (DNN). In particular, HyperDimensional Computing (HDC) and Vision Transformer (ViT) have demonstrated promising achievements in facilitating effective and reliable cognitive learning. This paper proposes SpatialHD, the first framework that combines spatial transformer networks (STN) and HDC. First, SpatialHD exploits the STN, which explicitly allows the spatial manipulation of data within the network. Then, it employs HDC to operate over STN output by mapping feature maps into high-dimensional space, learning abstracted information, and classifying data. In addition, the STN output is resized to generate a smaller input feature map. This further reduces computing complexity and memory storage compared to HDC alone. Finally, to test the model's functionality, we applied spatial HD for image classification, utilizing the MNIST and Fashion-MNIST datasets, using only 25% of the dataset for training. Our results show that SpatialHD improves accuracy by ≈ 8% and enhances efficiency by approximately 2.5x compared to base-HDC.

    Original languageBritish English
    Title of host publicationAICAS 2023 - IEEE International Conference on Artificial Intelligence Circuits and Systems, Proceeding
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    ISBN (Electronic)9798350332674
    DOIs
    StatePublished - 2023
    Event5th IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2023 - Hangzhou, China
    Duration: 11 Jun 202313 Jun 2023

    Publication series

    NameAICAS 2023 - IEEE International Conference on Artificial Intelligence Circuits and Systems, Proceeding

    Conference

    Conference5th IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2023
    Country/TerritoryChina
    CityHangzhou
    Period11/06/2313/06/23

    Keywords

    • Hyperdimensional Computing
    • Image Classification
    • Spatial Transformers

    Fingerprint

    Dive into the research topics of 'SpatialHD: Spatial Transformer Fused with Hyperdimensional Computing for AI Applications'. Together they form a unique fingerprint.

    Cite this