Automated User Experience (UX) Testing for Mobile Application: Strengths and Limitations

Abstract

User Experience (UX) evaluation has a significant importance for any interactive application. Mobile device applications have additional limitations to convey good user experiences (UX) due to the usage and features of mobile devices in ubiquitous computing contexts. There are a lot of automated tools available for evaluating, such applications particularly developed for Android and iOS. Automated UX evaluation provides a number of strengths which are able to overcome the limitations of non-automated (moderated) counterparts. Automated UX evaluation is regarded as unexplored field, especially when it is adopted for the UX evaluation of complex mobile application. Despite these, automated UX evaluation tools are unexplored and should only be used in coupling with traditional UX evaluation techniques. Hence, this study aims to discuss the literature in automated UX evaluation and to highlight the UX measurements that merit further investigation. This paper presents the most frequently used automated UX evaluation tools for mobile applications. Therefore, the study analyzes existing automated UX tools and frameworks and identifies which UX attributes and measurements of automated UX evaluation are likely to be of use in future research. Moreover, we discuss the strengths and limitations of automated UX evaluation methods for mobile applications. Finally, the paper provides an overview of automated UX evaluation techniques and tools. It also presents the strengths and limitations for comparing various evaluation methods.