Detecting face-touch hand moves using smartwatch inertial sensors and convolutional neural networks
Küçük Resim Yok
Tarih
2022
Yazarlar
Dergi Başlığı
Dergi ISSN
Cilt Başlığı
Yayıncı
Erişim Hakkı
info:eu-repo/semantics/openAccess
Özet
As per World Health Organization (WHO), avoiding touching the face when people are in public or crowded places is an effective\rway to prevent respiratory viral infections. This recommendation has become more crucial with the current health crisis and the worldwide\rspread of COVID-19 pandemic. However, most face touches are done unconsciously, that is why it is difficult for people to monitor their\rhand moves and try to avoid touching the face all the time. Hand-worn wearable devices like smartwatches are equipped with multiple\rsensors that can be utilized to track hand moves automatically. This work proposes a smartwatch application that uses small, efficient, and\rend-to-end Convolutional Neural Networks (CNN) models to classify hand motion and identify Face-Touch moves. To train the models,\ra large dataset is collected for both left and right hands with over 28k training samples that represents multiple hand motion types, body\rpositions, and hand orientations. The app provides real-time feedback and alerts the user with vibration and sound whenever attempting to\rtouch the face. Achieved results show state of the art face-touch accuracy with average recall, precision, and F1-Score of 96.75%, 95.1%,\r95.85% respectively, with low False Positives Rate (FPR) as 0.04%. By using efficient configurations and small models, the app achieves\rhigh efficiency and can run for long hours without significant impact on battery which makes it applicable on most off-the-shelf\rsmartwatches.
Açıklama
Anahtar Kelimeler
Kaynak
International Journal of Intelligent Systems and Applications in Engineering
WoS Q Değeri
Scopus Q Değeri
Cilt
10
Sayı
1
