Efficient Kinect Sensor-based Kurdish Sign Language Recognition Using Echo System Network

Mirza, Sami F. and Al-Talabani, Abdulbasit K. (2021) Efficient Kinect Sensor-based Kurdish Sign Language Recognition Using Echo System Network. ARO-THE SCIENTIFIC JOURNAL OF KOYA UNIVERSITY, 9 (2). pp. 1-9. ISSN 2410-9355

Text (Research Artical) ARO.10827-Vol9.No2.2021.ISSUE16-PP 1-9.pdf - Published Version Available under License Creative Commons Attribution Non-commercial Share Alike. Download (1MB)

Abstract

Sign language assists in building communication and bridging gaps in understanding. Automatic sign language recognition (ASLR) is a field that has recently been studied for various sign languages. However, Kurdish sign language (KuSL) is relatively new and therefore researches and designed datasets on it are limited. This paper has proposed a model to translate KuSL into text and has designed a dataset using Kinect V2 sensor. The computation complexity of feature extraction and classification steps, which are serious problems for ASLR, has been investigated in this paper. The paper proposed a feature engineering approach on the skeleton position alone to provide a better representation of the features and avoid the use of all of the image information. In addition, the paper proposed model makes use of recurrent neural networks (RNNs)-based models. Training RNNs is inherently difficult, and consequently, motivates to investigate alternatives. Besides the trainable long short-term memory (LSTM), this study has proposed the untrained low complexity echo system network (ESN) classifier. The accuracy of both LSTM and ESN indicates they can outperform those in state-of-the-art studies. In addition, ESN which has not been proposed thus far for ASLT exhibits comparable accuracy to the LSTM with a significantly lower training time.

Item Type:	Article
Uncontrolled Keywords:	Deep learning, Echo system network, Long short-term memory, Microsoft Kinect v2 Sensor, Recurrent neural network, Sign language
Subjects:	Q Science > Q Science (General) Q Science > QA Mathematics > QA76 Computer software
Divisions:	ARO-The Scientific Journal of Koya University > VOL 9, NO 2 (2021)
Depositing User:	Dr Salah Ismaeel Yahya
Date Deposited:	29 Mar 2022 06:25
Last Modified:	29 Mar 2022 06:25
URI:	http://eprints.koyauniversity.org/id/eprint/281

Actions (login required)

View Item