AI-Powered Personalised Mobile Learning Using Large Language Models: Design, Implementation, and a Simulation-Based Feasibility Evaluation
DOI:
https://doi.org/10.3991/ijim.v20i19.63181Keywords:
large language models, mobile learning, personalized education, adaptive testing, retrieval-augmented generation, intelligent tutoring systems, usability evaluationAbstract
The significance of mobile learning (m-learning) has been greatly highlighted by the advent of technology due to its flexibility, accessibility and capability of being used to learn at any time and place. The development of Large Language Models (LLMs) offers great potential for creating adaptive, conversational and content-aware learning experiences via mobile apps. Most existing mobile-learning systems, however, still provide largely static content and shallow personalisation, which limits sustained learner engagement and adaptive support. This paper presents the design and implementation of an Android-based, LLM-powered personalised m-learning platform that integrates four components: a conversational tutoring agent, an Item-Response-Theory (IRT)-based adaptive quiz engine, a Retrieval-Augmented Generation (RAG) content-recommendation module, and an analytics-driven feedback loop. We describe the system architecture, the prompt-orchestration and knowledge-tracing pipelines, and a rigorous quasi-experimental evaluation protocol (pre-/post-test, System Usability Scale (SUS), and engagement analytics) designed for a controlled classroom deployment. To validate the core algorithmic contributions prior to human-subject trials, we conduct two simulation-based feasibility studies: (i) a synthetic-learner simulation comparing the adaptive difficulty engine against a static item sequence and (ii) a retrieval-precision benchmark comparing RAG-based content recommendation against keyword-matching on a synthetic tagged corpus. The adaptive engine delivered quiz items within the optimal challenge zone (0.4 < P(correct) < 0.8) for 77.8% of interactions, compared with 40.8% for the static baseline, while the RAG recommender achieved substantially higher retrieval precision at every cut-off (P@10 = 0.845 versus 0.483 for keyword matching). These results provide algorithmic evidence that the proposed adaptive and retrieval components behave as intended and motivate the full-scale classroom evaluation described in the protocol. The paper concludes with a discussion of design implications, limitations, and a concrete plan for the human-subject study and future extensions of the platform.
References
[1] Sharma, S.; Mittal, P.; Kumar, M.; Bhardwaj, V. The role of large language models in personalized learning: a systematic review of educational impact. Discover Sustainability 2025, 6, 243.
[2] Liu, J.; Jiang, B.; Wei, Y. How large language models can revolutionize teaching as personalized assistants. ECNU Review of Education, published online 2 January 2025.
[3] Large language models in education: a systematic review of empirical applications, benefits, and challenges (empirical review of 88 studies, Nov. 2022–Mar. 2025). Computers and Education: Artificial Intelligence, 2025.
[4] Ng, C.; Fung, Y. Educational Personalized Learning Path Planning with Large Language Models. arXiv preprint arXiv:2407.11773, 2024.
[5] Lim, J.J.Y.; Zhang-Li, D.; Yu, J.; Cong, X.; He, Y.; Liu, Z.; Liu, H.; Hou, L.; Li, J.; Xu, B. Learning in Context: Personalizing Educational Content with Large Language Models to Enhance Student Learning. arXiv preprint arXiv:2509.15068, 2025.
[6] Do Students Rely on AI? Analysis of Student-ChatGPT Conversations from a Field Study. arXiv preprint arXiv:2508.20244, 2025.
[7] Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends. arXiv preprint arXiv:2401.07518, 2024.
[8] Manoharan, I. MCAT Quiz and Study Mobile App Development Project Using ChatGPT API, Machine Learning, and Data Science. Medium, 2024.
[9] ChatPRCS: A Personalized Support System for English Reading Comprehension based on ChatGPT. arXiv preprint arXiv:2309.12808, 2023.
[10] Method and apparatus for adaptive learning. U.S. Patent 10,332,412.
[11] AdaptiveGPT: Towards Intelligent Adaptive Learning. Multimedia Tools and Applications, 2024.
[12] Alshahrani, et al. Evaluating the Effectiveness of Chatbot-Assisted Learning in Enhancing English Conversational Skills Among Secondary School Students. Education Sciences 2025, 15, 1136.
[13] Subject-Specialized Chatbot in Higher Education as a Tutor for Autonomous Exam Preparation: Analysis of the Impact on Academic Performance and Students' Perception of Its Usefulness. Education Sciences 2025, 15, 26.
[14] A Lecture-Specific AI-Based Tutor for Higher Education: Pedagogical Design and Empirical Evaluation. Education Sciences 2026, 16, 812.
[15] From Co-Design to Metacognitive Laziness: Evaluating Generative AI in Vocational Education. arXiv preprint arXiv:2512.12306, 2025.
[16] From rules to language models: a comparative study of chatbot learning assistants. Frontiers in Education 2026, 11, 1794807.
[17] Analysing Conversation Pathways with a Chatbot Tutor to Enhance Self-Regulation in Higher Education. Education Sciences 2024, 14, 590.
[18] Beyond Traditional Teaching: The Potential of Large Language Models and Chatbots in Graduate Engineering Education. arXiv preprint arXiv:2309.13059, 2023.
[19] Almaiah, M.A.; Alamri, M.M.; Al-Rahmi, W. Applying the UTAUT model to explain the students' acceptance of mobile learning system in higher education. Electronics 2021, 10, 3171.
[20] Unified theory of acceptance and use of technology (UTAUT) in mobile learning adoption: Systematic literature review and bibliometric analysis. COLLNET Journal of Scientometrics and Information Management 2022, 16, 75–116.
[21] Understanding Undergraduate Students' Adoption of Mobile Learning Model: A Perspective of the Extended UTAUT2.
[22] Acceptance Analysis Of Mobile Learning Using The Unified Theory Of Acceptance And Use Of Technology (UTAUT): The Case Of Asynchronous Learners. International Journal of Educational Research & Social Sciences, 2023.
[23] Determining mobile learning acceptance outside the classroom: an integrated acceptance model. Educational Technology Research and Development, 2025.
[24] Investigating Students' Intention to Use M-Learning. ScienceDirect, 2024/2025.
[25] For Sustainable Application of Mobile Learning: An Extended UTAUT Model to Examine the Effect of Technical Factors on the Usage of Mobile Devices as a Learning Tool. Sustainability 2021, 13, 1856.
[26] Alowayr, A. Determinants of mobile learning adoption: extending the unified theory of acceptance and use of technology (UTAUT). International Journal of Information and Learning Technology 2022, 39, 1–12.
[27] Usability Measurement of Mobile Applications with System Usability Scale (SUS). 2023 11th International Conference on Information and Communication Technology, 2023.
[28] Teachers' Evaluation of the Usability of a Self-Assessment Tool for Mobile Learning Integration in the Classroom. Education Sciences 2024, 14, 1.
[29] Perceived Usability Evaluation of Educational Technology Using the Post-Study System Usability Questionnaire (PSSUQ): A Systematic Review. Sustainability 2023, 15, 12954.
[30] Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education 2022, 54, 392–409.
[31] Hyzy, M.; Bond, R.; Mulvenna, M.; Bai, L.; Dix, A.; Leigh, S.; Hunt, S. System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis. JMIR mHealth and uHealth 2022, 10, e37290.
[32] TutorLLM: Customizing Learning Recommendations with Knowledge Tracing and Retrieval-Augmented Generation. arXiv preprint arXiv:2502.15709, 2025.
[33] An LLM-Powered Assessment Retrieval-Augmented Generation (RAG) For Higher Education. arXiv preprint arXiv:2601.06141, 2026.
[34] Kim, S.; Maciag, P.S. Combining Retrieval-Augmented Text Generation with LLMs for Reading Content Recommendations. arXiv preprint arXiv:2606.14817, 2026.
[35] Personalization of Large Language Models: A Survey. arXiv preprint arXiv:2411.00027, 2024.
[36] Izourane, F.-Z.; Bella, B.; Ardchir, S.; Ounacer, S.; Azzouazi, M. Decoding Online Student Behavior and Procrastination Using Clustering and Predictive Analytics. International Journal of Online and Biomedical Engineering (iJOE) 2026, 22, 67–85. https://doi.org/10.3991/ijoe.v22i07.61225
[37] Vu, T.; Luong, T.-K.; Bui, T.; Dang, Q.; Nguyen, P.-A.; Le, N. Smart Medical Robots: Dynamic LLM Routing for Question-Answering Systems. International Journal of Online and Biomedical Engineering (iJOE) 2026, 22, 43–61. https://doi.org/10.3991/ijoe.v22i04.57551
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 T. Ragupathi, J. Nithyashri, Partheeban Nagappari, M. Jamuna Rani, B. Neeththi Aadithiya

This work is licensed under a Creative Commons Attribution 4.0 International License.

