Multi-Sensing Data Fusion for Human Activity Recognition based on Neuromorphic Computing

Zheqi Yu, Adnan Zahid, William Taylor, Hadi Heidari, Muhammad A. Imran, Qammer H. Abbasi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a multi-sensing Human Activity Recognition framework, which uses Neuromorphic computing to processing from Sensors and Radars of different type signals for data fusion and classification. At this point, Inertial Measurement Unit sensors and Universal Software-defined Radio Peripheral, and Radar devices are used to collect human activities signals separately. The feature extraction and selection process the sensors signal to dimension reduction without time factor by design an attention mechanism. And then, following Expectation-Maximization calculation to achieve a binary feature pattern that fits the discrete Hopfield neural network input. Depend on the Neuromorphic computing of associative memory function and similarity calculation to the neurons' feedback output. It finally achieves human activity recognition with one-shot learning. There are explores multi-sensing human activity recognition between limited dataset and ensures accuracy without dropping. The technique can be extended to include more hardware signal processing to the system.

Original languageEnglish
Title of host publication2021 IEEE USNC-URSI Radio Science Meeting (Joint with AP-S Symposium)
PublisherIEEE
Pages64-65
Number of pages2
ISBN (Electronic)9781946815101
DOIs
Publication statusPublished - 10 Feb 2022
Event2021 IEEE USNC-URSI Radio Science Meeting (Joint with AP-S Symposium) - Singapore, Singapore
Duration: 4 Dec 202110 Dec 2021

Conference

Conference2021 IEEE USNC-URSI Radio Science Meeting (Joint with AP-S Symposium)
Abbreviated titleUSNC-URSI 2021
Country/TerritorySingapore
CitySingapore
Period4/12/2110/12/21

Keywords

  • Artificial Intelligence
  • Data Fusion
  • Human Activity Recognition
  • Signal Processing

ASJC Scopus subject areas

  • Radiation
  • Computer Networks and Communications
  • Instrumentation

Fingerprint

Dive into the research topics of 'Multi-Sensing Data Fusion for Human Activity Recognition based on Neuromorphic Computing'. Together they form a unique fingerprint.

Cite this