A Development of Multi-Language Interactive Device using Artificial Intelligence Technology for Visual Impairment Person

Norharyati Binti Harum, Nur’aliah Izzati M. S. K, Nurul Akmar Emran, Noraswaliza Abdullah, Nurul Azma Zakaria, Erman Hamid, Syarulnaziah Anawar

Abstract


The issue of lacking reference books in braille in most public building is crucial, especially public places like libraries, museum and others. The visual impairment or blind people is not getting the information like we normal vision do. Therefore, a multi languages reading device for visually impaired is built and designed to overcome the limitation of reference books in public places. Some research regarding current product available is done to develop a better reading device. This reading device is an improvement from previous project which only focuses on single language which is not suitable for public places. This reading device will take a picture of the book using 5MP Pi camera, Google Vision API will extract the text, and Google Translation API will detect the language and translated to desired language based on push buttons input by user. Google Text-to-Speech will convert the text to speech and the device will read out aloud in through audio output like speaker or headphones.   A few testings have been made to test the functionality and accuracy of the reading device. The testings are functionality, performance test and usability test. The reading device passed most of the testing and get a score of 91.7/100 which is an excellent (A) rating.


Keywords


Book reader; image-text conversion; Text-to-speech; Google Cloud; Artificial Intelligence; Visual Impairment People

Full Text:

PDF



International Journal of Interactive Mobile Technologies (iJIM) – eISSN: 1865-7923
Creative Commons License
Indexing:
Scopus logo IET Inspec logo DBLP logo EBSCO logo Ulrich's logo MAS logo