Mobile Music Therapy Integrating AI-Driven Emotion Prediction and a Human-Computer Interaction Experience Model

Abstract

The integration of affective computing with mobile health technologies has created transformative opportunities for scalable and personalized music therapy. However, traditional music therapy remains limited by insufficient personalization, subjective emotion assessment, and low adaptability in human–computer interaction (HCI). Existing artificial intelligence (AI) emotion prediction methods also lack robust multimodal data fusion in mobile environments and alignment with clinical workflows. A closed-loop mobile music therapy system incorporating multimodal AI emotion prediction was developed in this study to address these limitations. The system integrates multimodal emotion sensing, dynamic therapy matching, empathic interaction, and closed-loop optimization. A convolutional neural network-long short-term memory (CNN-LSTM) hybrid model was employed to predict emotional states using physiological signals, behavioral features, and subjective feedback, while a prescriptive dynamic music therapy model and a multidimensional HCI evaluation framework were constructed. Experimental results showed that the multimodal CNN–LSTM model outperformed unimodal models and traditional algorithms, and the closed-loop system achieved significantly greater improvements in emotional regulation and stress reduction than non-adaptive interventions (traditional therapy approaches and static playlists). Dynamic enhancements in heart rate variability and reductions in cortisol levels provided objective physiological evidence of therapeutic efficacy. The empathic interaction framework increased usability and treatment adherence. Mediation analysis confirmed the pathway linking emotion prediction, music therapy matching, and outcome enhancement. Superior efficacy in individuals with anxiety or depressive tendencies further highlighted scenario-specific therapeutic responsiveness compared with postoperative rehabilitation groups. This study advances the integration of AI and music therapy, and the proposed real-time mapping model linking emotional states, music parameters, and interaction feedback provides an actionable framework for the development of empathic AI systems in healthcare. The closed-loop design establishes a new paradigm for personalized mobile medical interventions with significant clinical and interdisciplinary relevance.