Real time gesture recognition results to control a five-finger dexterous robot

An IoT-Enabled Stroke Rehabilitation System Based On Smart Wearable Armband And Machine Learning

An IoT-Enabled Stroke Rehabilitation System Based On Smart Wearable Armband And Machine Learning 745 426 IEEE Journal of Translational Engineering in Health and Medicine (JTEHM)

           
Part of the Special Issue on Advanced Internet of Things in Personalized Healthcare Systems: Validation, Analysis and Utilization

Abstract

Real time gesture recognition results to control a five-finger dexterous robot
Surface electromyography signal plays an important role in hand function recovery training. In this paper, an IoT-enabled stroke rehabilitation system was introduced which was based on a smart wearable armband (SWA), machine learning (ML) algorithms, and a 3-D printed dexterous robot hand. User comfort is one of the key issues which should be addressed for wearable devices. The SWA was developed by integrating a low-power and tiny-sized IoT sensing device with textile electrodes, which can measure, pre-process, and wirelessly transmit bio-potential signals. By evenly distributing surface electrodes over user’s forearm, drawbacks of classification accuracy poor performance can be mitigated. A new method was put forward to find the optimal feature set. ML algorithms were leveraged to analyze and discriminate features of different hand movements, and their performances were appraised by classification complexity estimating algorithms and principal components analysis. According to the verification results, all nine gestures can be successfully identified with an average accuracy up to 96.20%. In addition, a 3-D printed five-finger robot hand was implemented for hand rehabilitation training purpose. Correspondingly, user’s hand movement intentions were extracted and converted into a series of commands which were used to drive motors assembled inside the dexterous robot hand. As a result, the dexterous robot hand can mimic the user’s gesture in a real-time manner, which shows the proposed system can be used as a training tool to facilitate rehabilitation process for the patients after stroke.