A Development of Multi-Language Interactive Device using Artificial Intelligence Technology for Visual Impairment Person

Authors

  • Norharyati Binti Harum Universiti Teknikal Malaysia Melaka https://orcid.org/0000-0003-0068-6025
  • Nur’aliah Izzati M. S. K Universiti Teknikal Malaysia Melaka
  • Nurul Akmar Emran Universiti Teknikal Malaysia Melaka
  • Noraswaliza Abdullah Universiti Teknikal Malaysia Melaka
  • Nurul Azma Zakaria Universiti Teknikal Malaysia Melaka
  • Erman Hamid Universiti Teknikal Malaysia Melaka
  • Syarulnaziah Anawar Universiti Teknikal Malaysia Melaka

DOI:

https://doi.org/10.3991/ijim.v15i19.24139

Keywords:

Book reader, image-text conversion, Text-to-speech, Google Cloud, Artificial Intelligence, Visual Impairment People

Abstract


The issue of lacking reference books in braille in most public building is crucial, especially public places like libraries, museum and others. The visual impairment or blind people is not getting the information like we normal vision do. Therefore, a multi languages reading device for visually impaired is built and designed to overcome the limitation of reference books in public places. Some research regarding current product available is done to develop a better reading device. This reading device is an improvement from previous project which only focuses on single language which is not suitable for public places. This reading device will take a picture of the book using 5MP Pi camera, Google Vision API will extract the text, and Google Translation API will detect the language and translated to desired language based on push buttons input by user. Google Text-to-Speech will convert the text to speech and the device will read out aloud in through audio output like speaker or headphones.   A few testings have been made to test the functionality and accuracy of the reading device. The testings are functionality, performance test and usability test. The reading device passed most of the testing and get a score of 91.7/100 which is an excellent (A) rating.

Author Biographies

Norharyati Binti Harum, Universiti Teknikal Malaysia Melaka

Faculty of Information & Communication Technology
Universiti Teknikal Malaysia Melaka

Nur’aliah Izzati M. S. K, Universiti Teknikal Malaysia Melaka

Faculty of Information & Communication Technology
Universiti Teknikal Malaysia Melaka

Nurul Akmar Emran, Universiti Teknikal Malaysia Melaka

Faculty of Information & Communication Technology
Universiti Teknikal Malaysia Melaka

Noraswaliza Abdullah, Universiti Teknikal Malaysia Melaka

Faculty of Information & Communication Technology
Universiti Teknikal Malaysia Melaka

Nurul Azma Zakaria, Universiti Teknikal Malaysia Melaka

Faculty of Information & Communication Technology
Universiti Teknikal Malaysia Melaka

Erman Hamid, Universiti Teknikal Malaysia Melaka

Faculty of Information & Communication Technology
Universiti Teknikal Malaysia Melaka

Syarulnaziah Anawar, Universiti Teknikal Malaysia Melaka

Faculty of Information & Communication Technology
Universiti Teknikal Malaysia Melaka

Downloads

Published

2021-10-12

How to Cite

Harum, N. B., M. S. K, N. I., Emran, N. A., Abdullah, N., Zakaria, N. A., Hamid, E., & Anawar, S. (2021). A Development of Multi-Language Interactive Device using Artificial Intelligence Technology for Visual Impairment Person. International Journal of Interactive Mobile Technologies (iJIM), 15(19), pp. 79–92. https://doi.org/10.3991/ijim.v15i19.24139

Issue

Section

Papers