Development of Indonesian Text-to-Audiovisual Synthesis System Using Syllable Concatenation Approach to Support Indonesian Learning

Authors

  • Arifin _ Informatics Department of Dian Nuswantoro University, Semarang, Indonesia
  • Surya Sumpeno Electrical Engineering Department, Institut Teknologi Sepuluh Nopember (ITS), Surabaya, Indonesia
  • Mochamad Hariadi Electrical Engineering Department, Institut Teknologi Sepuluh Nopember (ITS), Surabaya, Indonesia
  • Arry Maulana Syarif Informatics Department of Dian Nuswantoro University, Semarang, Indonesia

DOI:

https://doi.org/10.3991/ijet.v12i02.6384

Keywords:

Indonesian Text-To-Audiovisual synthesis system, Indonesian texts, Syllable concatenation approach, viseme

Abstract


This study aims to develop of Indonesian Text-to-Audiovisual synthesis system using syllable concatenation approach to support Indonesian learning. This system can visualize the syllable pronunciation synchronized with the speech signal so that it can provide a realistic illustration of the articulator movement when each phoneme is pronounced. Syllable concatenation approach is used to realize a realistic visualization by assembling articulation and coarticulation in the form of syllables. In the development of the system, we have recorded speech database in the syllables form which refers to the patterns of syllables in Indonesian. The syllable concatenation approach is used to concatenate viseme of each phoneme, and to form the visualization of syllable pronunciations. It is synchronized with the corresponding speech from the speech database. Evaluation of this system is conducted based on a "lips-reading" of the 10 Indonesian sentences entered into the system. Ratings are based on the degree of correspondence between the syllable pronunciation and the speech produced. Assessment of all respondents is calculated using MOS (Mean Opinion Score). The calculation results show that the Indonesian text-to-audiovisual system has produced the pronunciation visualization more realistic and smoother.

Downloads

Published

2017-02-28

How to Cite

_, A., Sumpeno, S., Hariadi, M., & Syarif, A. M. (2017). Development of Indonesian Text-to-Audiovisual Synthesis System Using Syllable Concatenation Approach to Support Indonesian Learning. International Journal of Emerging Technologies in Learning (iJET), 12(02), pp. 166–184. https://doi.org/10.3991/ijet.v12i02.6384

Issue

Vol. 12 No. 02 (2017)

Section

Papers

License

The submitting author warrants that the submission is original and that she/he is the author of the submission together with the named co-authors; to the extend the submission incorporates text passages, figures, data or other material from the work of others, the submitting author has obtained any necessary permission.
Articles in this journal are published under the Creative Commons Attribution Licence (CC-BY What does this mean?). This is to get more legal certainty about what readers can do with published articles, and thus a wider dissemination and archiving, which in turn makes publishing with this journal more valuable for you, the authors.
By submitting an article the author grants to this journal the non-exclusive right to publish it. The author retains the copyright and the publishing rights for his article without any restrictions.