Design of a Sign Language-to-Natural Language Translator Using Artificial Intelligence

Authors

  • Hernando Gonzalez Universidad Autónoma de Bucaramanga https://orcid.org/0000-0001-6242-3939
  • Silvia Hernández Universidad Autónoma de Bucaramanga
  • Oscar Calderón Universidad Autónoma de Bucaramanga

DOI:

https://doi.org/10.3991/ijoe.v20i03.46765

Keywords:

Sign language, neural network, signal processing, pattern recognition

Abstract


This paper describes the results obtained from the design and validation of translation gloves for Colombian sign language (LSC) to natural language. The MPU6050 sensors capture finger movements, and the TCA9548a card enables data multiplexing. Additionally, an Arduino Uno board preprocesses the data, and the Raspberry Pi interprets it using central tendency statistics, principal component analysis (PCA), and a neural network structure for pattern recognition. Finally, the sign is reproduced in audio format. The methodology developed below focuses on translating specific preselected words, achieving an average classification accuracy of 88.97%.

Downloads

Published

2024-02-27

How to Cite

Gonzalez, H., Hernández , S. ., & Calderón , O. . (2024). Design of a Sign Language-to-Natural Language Translator Using Artificial Intelligence. International Journal of Online and Biomedical Engineering (iJOE), 20(03), pp. 89–98. https://doi.org/10.3991/ijoe.v20i03.46765

Issue

Section

Papers