The Development of POTENSIA; The Android-Based Psychological Application for Mapping and Assessments of Student Mental Health During the COVID-19 Pandemic

Students experience various essential changes related to their psychological conditions during their education in college. Students’ adaptability to the demands of these changes will give birth to new skills for the next stage of psychological development. However, academic stress, social problems, career, and personal-emotional problems can hinder the productivity and development of students in terms of mental health. This issue increased with the new-normal life during the COVID-19 pandemic, which also impacted the education process. For this reason, it is necessary to have a mobile-based online psychological assessment to map the mental health conditions of students during the pandemic. This study aims to develop and validate an Android-based online psychological assessment application to map students’ mental health conditions. This study involved ten experts in counseling and software development, five counselors, and 638 users of the POTENSIA application. According to application development needs, data analysis using Aiken’s V coefficient test, Confirmatory Factor Analysis (CFA), and Rasch Model Analysis. The results of the study prove that the application is considered valid and practical to use. The effectiveness of the application is considered very good in mapping the mental health conditions of students. Keywords—android-based applocation, mental health, college student, COVID-19 pandemic


Introduction
College students must be individuals with logical and planning abilities at the higher education stage [1][2][3]. To achieve this, students experience changes in their roles, functions, and psychological development. The transition from high school to higher education creates psychological dynamics changes [4,5]. Aspects that are determinants of psychological change and development such as cultural changes, new environments, living separately from parents, significant academic atmosphere changes, and college choices can be reasons for early future career choices [5][6][7][8]. For this reason, students should have basic knowledge and insight about these changing conditions. This insight also increases students' adaptability to these changes by increasing skills which are a stage of life. The adaptation is an individual process in responding to changes that occur in the environment that can affect the individual's physical and psychological [9,10]. The process of adaptation of students to the new environment in higher education, is characterized by four types of adaptation, academic adaptation, adaptation to the social environment, adaptation to personal-emotional, and adaptation to institutions [10]. The adaptation process in higher education is also a process that requires coping skills in adjusting to various fields [11]. Students' adaptability to these changes will form new skills that can be used in the next stage of life [12,13]. This is a manifestation of ability to face challenges while studying at university.
As a country with a demographic bonus of productive age, education in Indonesia demands quality from every student it accepts [14][15][16]. Various improvements to the quality of learning and curriculum are the focus of higher education, including strengthening students' academic atmosphere and research [17,18]. However, the emergence of the Covid-19 virus outbreak, which has become a worldwide pandemic, has resulted in very drastic lifestyle changes [19,20]. The phenomenon in the field states that students in lectures face problems. Problems in the education process at universities are ineffective discussions, less active in attending lectures, lack of interaction between lecturers and students, difficulties in attending practical classes, and the psychological burden caused by the online learning process [21][22][23]. The emergence of the Covid-19 pandemic requires students to improve their adaptability to new educational patterns in higher education.
However, not a few of the students experienced academic pressure, the study load was overloaded, and the learning atmosphere was dense, impacting students' mental health conditions [20,24,25]. Like physical health, mental health is significant for humans. Mental health can be shown by individuals who are free from various symptoms of mental disorders. Thus, mentally healthy students can live their lives normally and adapt to managing stress to deal with the problems they will encounter [26,27]. Meanwhile, students who experience mental disorders tend to bring up negative cognitions so that they can cause depression and disrupt the lecture process [28].
Mental health problems experienced by students also impact low academic achievement and delays in completing studies [27,29]. This problem makes it difficult for students to adjust to the new system like the network in access to web learning (e-learning) which must be stable, lecture materials are not as straightforward as direct lectures, and academic schedules are delayed and delayed [30][31][32][33]. In addition to problems directly related to the learning process, there are also stressors from the students' daily lives themselves [34]. The impact of development experienced by students during COVID-19 encourages the emergence of mental health problems. Mental health problems that have developed during this pandemic are stress, anxiety, and even depression. For students, this pandemic causes stress and nervousness, marked by changes in interactions in the learning process and daily life [35,36].
Efforts to manage students' mental health conditions should be carried out more optimally [33,34,37]. In the current state of development of mobile technology, handling student mental health conditions can be done quickly, efficiently, and effectively [38]. Therefore, handling student mental health problems should be preceded by a quick and efficient mapping of mental health conditions, also paying attention to health protocols.
The mapping of mental health conditions considers the speed of obtaining data from the assessment and the possibility of appropriate counseling interventions. This effort requires the precision of the assessment coupled with the flexibility of the medium. Then, counseling intervention as the end of maintaining mental health conditions must be based on baseline data obtained from the assessment [16,39]. Therefore, it is necessary to have an accurate assessment and suitable media to obtain precise data about the mental health condition of students during the COVID-19 pandemic.
One of the steps in meeting the target of appropriate counseling interventions for students' mental health conditions during the COVID-19 pandemic is to develop an online psychological assessment application. The focus of this research is to develop and validate an Android-based online psychological assessment application called POTENSIA.

2
Research methods

Research design
POTENSIA application development is carried out using the ADDIE Model method as seen in Figure 1. The use of this model adapts to the needs and objectives of this application, which focuses on developing an online student needs assessment platform that will be used as the basis for planning counseling interventions in universities.
The process of data analysis based on a needs study is carried out first to obtain data on the acceptance of the target application for the program to be developed. This process involves a series of tests that have been carried out from 2017 to 2020. In addition, retesting is also carried out before the design process is carried out to ensure the features that will be developed in the application. The design stage involves a series of processes for compiling the user interface (UI) and user experience (UX) through a design application. UI and UX requirements are adjusted to the results of the previous needs assessment. By compiling the final results from UI and UX, we get an application for mental health assessment that can be accessed on Android-based devices. The development and implementation process aims to get an assessment from the expert as described in the participant section. The practicality of the application is obtained through the acceptability of the application's assessment. Furthermore, in the effectiveness test process, respondents were tested to determine the accuracy of the online assessment developed in the application. The acceptability value from the counselor's side in interpreting the assessment results in a counseling path in service planning. Finally, an evaluation process is carried out to obtain holistic assessment results and serve as a baseline for application improvement.

Participant
The data in this study were collected from various segments according to the type of testing carried out. At the development stage, this research involved five experts in assessment in counseling and five experts in the treatment and education-based software development. Then at the practicality measurement stage and respondents' acceptance of the application, data were obtained by involving 638 students from all over Indonesia who were randomly selected. The effectiveness of the application is carried out by testing the online assessment on the application to obtain the data accuracy coefficient. Furthermore, the measurement of acceptability in terms of interpretation of the assessment results was carried out on five counselors who made plans for counseling services.
To ensure the use of the respondent's data, the respondent was asked for a consent form for data collection and publication. This process is carried out entirely through distance as a form of anticipation of the spread of the Covid-19 virus. The data collection process was also carried out using the POTENSIA application, which the respondent first installed.

Measurement
This application development process involves a series of tests and instruments that adjust at each step. The instruments involved in this research are expert validation sheets, the Acceptability of Mental-Health Mobile App Survey (AMMS) [38,39], and a measuring tool that is a feature of the application, namely the Zadrian-Ifdil Problem Checklist (ZIPC).
Measurement of the instrument's validity is carried out through the Rasch Model Analysis test to obtain the accuracy of measuring data, missing data conditions, and the ability to measure data outliers. In addition, testing using Confirmatory Factor Analysis (CFA) was also carried out to test the instrument's construct so that the data obtained did show the acceptability of the product developed robustly.
AMMS testing using Rasch Model Analysis produces a Cronbach Alpha reliability coefficient value of 0.92. Furthermore, testing of the measured dimensions is carried out through unidimensionality testing. The series of dimensionality tests will have an impact on the CFA analysis. Unidimensionality testing obtained raw variance units of 50.7% with a total unexplained variable of 11.1%. This condition proves that the instrument has explained more than half of the variable units in the construct measured with good precision. Based on the CFA analysis from the Table 1, this measuring instrument also provides a coefficient that proves the construct it has compiled. Of all the items in the AMMS, all of them have a loading factor with a p-value < 0.001 with an estimated correlation coefficient that is strong enough to be excellent. This condition proves that the measuring instrument used to determine the level of acceptability of respondents to the application is proven to be good. Meanwhile, the use of the ZIPC instruments will be described in the results and discussion section.

Development tools
Application development involves a set of software that is based on needs. For User Interface (UI) needs, the tools used are Adobe Illustrator 2020 version 24.0.0 to get unique icon designs and application characteristics [40]. Meanwhile, for the needs of User Experience (UX) using the Sketch software version 58; where this application can consider the user's convenience in using the application [41,42]. The coding process to build the application using Visual Code Studio version 1.56.0 using the React Native framework to build Android applications.

Data analysis
The acceptability of the application is obtained from an expert assessment which is then formulated and analyzed using Aiken's V. This formula will produce an index that determines whether the prototype assessed has met face validity and content validity requirements from mental health assessment experts. Testing using the Aiken's V formula was also carried out for counselors to determine the acceptability index within the scope of planning counseling services from online assessments.
Meanwhile, to get the value of practicality and acceptance of respondents to the developed application, an analysis was carried out using Rasch Model Analysis. Then to determine the accuracy of the online assessment developed in the application, testing was carried out through Confirmatory Factor Analysis to produce an index of construct validity and strength for each item in compiling the developed online assessment.

3
Result and discussion

Main features of application
The application development process goes through three main phases, resulting in features that support the online psychological assessment process. The first phase is the design process for the User Interface (UI) and User Experience (UX) of the application. UI development is carried out by considering the uniqueness of the application and the design convenience of the application environment. This process will produce every icon and symbol used as long as the application is running on the user's device. At the same time, UX development is carried out to create user comfort in using the application. This process is carried out by compiling each application layer with logic and algorithms that present the conditions and the actual psychological assessment process as seen in Figure 2. This application consists of 4 main layers: sign up/log in and profiling, home as seen in Figure 3, assessment as seen in Figure 4, and result as seen in Figures 5 and 6. In the first layer, the user can directly see the available features. However, to be able to access these features, the user must first register. The user can access the home and the type of assessment provided by the application in the second and third layers. In the last layer, the application will provide access to view the results of the assessment.
The main feature provided by the POTENSIA application is a career exploration feature based on Holland's career theory. The assessment results will display a hexagonal graph containing the trend towards the user's career direction [43]. This assessment contains several statements that the user can select. The final results of this assessment can also be accessed by mental health professionals (such as counselors or psychologists) by entering the referral code of the professional. The next feature provided by this application is an assessment that can accurately predict the current state of mental health and problems experienced by users through the Zadrian-Ifdil Problem Checklist (ZIPC) measuring tool [44]. This measuring tool serves to map the mental health conditions and problems experienced by the user. Counselors will later use data from the mapping process in planning counseling services.

Fig. 6. Assessment reports that can be accessed by users and counselors
As seen in Figure 4, the user can fill in the ZIPC measuring instrument according to the conditions he is experiencing. These results will be obtained shortly after the user has finished filling out the instrument. The data from the instrument entry will be processed immediately and can be accessed by the user. The report can also be accessed by professionals whom the previous user has selected according to the referral code. This condition can only occur with the client's approval or on the condition that the application has collaborated with the agency that provides counseling services.
The report results will be used as a counselor as a basis for determining and planning counseling services. In addition, the counselor can provide intervention and follow-up based on the user's achievement of the assessment results. The client's condition can be seen periodically by the counselor with a precise timestamp so that monitoring of the data on the development of the client's mental health condition can be carried out longitudinally or continuously. The follow-up and reports will also be recorded in the application database and can be reused by counselors.

Validity
In knowing the relevance of the elements in the application with the components that should exist in the psychological assessment process, testing is carried out through expert judgment. The experts involved in this process have produced many psychological measuring tools in Indonesia and are widely used. In the process, experts are asked to study the application blueprint and access the application as a whole, both from the user's side and from the administrator's side.
The data obtained from the expert judgment process is then analyzed through Aiken's V. This process produces the Aiken coefficient, which describes the agreement conditions between each expert on the assessed application. This process will generate the validity conditions of the application through five dimensions, namely relevance, efficiency, effectiveness, impact, and attractiveness as seen in Table 2. In general, when viewed from the acceptance value of Aiken's V coefficient, all dimensions measured from the application show valid conditions (> 0.8). There is only one dimension at the threshold of acceptance of Aiken's V coefficient, namely the impact dimension. Overall application developed is considered valid by the expert. In other words, the application in terms of content, content, and face is reliable for measuring or assessing the psychological condition of the user.
On the other hand, to find out the application acceptance index from the counselor's side, testing is also carried out by involving dimensions according to the counselor's needs. Dimensions measured to determine the acceptance index include format, language usage, content, efficiency, effectiveness, and impact. This measurement will also directly prove that the application can indeed be used by counselors in the process of preparing and planning counseling services, both as a baseline for user data and program preparation regularly. The test results prove that all the dimensions measured are considered acceptable by the counselor user as the user of the assessment data as seen in Table 3. There is only one dimension (language usage) right on the threshold of acceptance of Aiken's V index. As a user of assessment data, counselors have good acceptance of applications used in service planning efforts and counseling service baseline data. There is one dimension that is at quite an acceptable level, and after being explored, this dimension is related to the rules of using language on the instrument. The follow-up to the condition of using the language is to simplify the sentence again in the assessment.
In addition, from the dimensions of efficiency and assessment format, counselors as data users also consider that the POTENSIA application can be relied on in the assessment process during the Covid-19 pandemic. The limited mobility of student users to visit the counseling service center is considered by college counselors as a challenge by the POTENSIA application. This is also revealed from the application practicality data in Table 4.

Practicality
Measurement of the practicality of the application was carried out on 638 respondents who had used the application to conduct online psychological assessments. This measurement is done by asking the user to fill out the AMMS instrument with four dimensions: behavioral intention, substitutive, complementary, and personal innovativeness. All of these dimensions will describe the overall user perception of the application.
Testing using Rasch Model Analysis produces an index that generally explains that the application is acceptable and practical according to the user. User acceptance is proven by all the items tested, showing a rescaling logit value above 40 points. In addition, the acquisition of the logit coefficient value means that there is a positive tendency for users to assess the POTENSIA application.  When analyzed on each item, it can be observed that users find it easy to express their condition through an online psychological assessment on the POTENSIA application; this is evidenced by the acquisition of a logit value of 1.12 and a rescaling logit coefficient of 57.83. In probability, the possibility of users to continue using the application can be reflected in the acquisition of behavioral intention aspects, especially in the desire to conduct an assessment if they feel uncomfortable, with a rescaling logit coefficient of 43.78. Overall, the MNSQ outfit value also shows acceptable conditions, this strengthens the assumption that users tend to have no problems using the application or the usage error rate is relatively low.

Effectivity
The effectiveness of POTENSIA application is known by measuring the strength and ability of the application in measuring the user's psychological condition. The instrument used in this measurement is ZIPC which has been included in the application and is one of the main features of POTENSIA apps. The strength of the construct and the acquisition of factor coefficients from the instrument indicate the POTENSIA's ability to carry out psychological assessments accurately. Factors in describing and predicting user conditions are the primary domain of application effectiveness in knowing the user's mental health condition. Testing the model through Chi-square proves that significantly the null hypothesis can be rejected as seen in Table 5. This condition proves that all the items contained in the assessment are the same construct and support each other. In other words, the assessment can   If analyzed from the point of view of factor loadings on each item from Table 6, it can be seen that all items have a good construct in describing individual mental health conditions. If analyzed based on estimated factor loadings and their relation to standard scores, it can be interpreted that there is a significant correlation between indicators and their latent constructs. On the other hand, the standard score explains the magnitude of the deviation between individuals with various z-value coefficients, especially on the education indicator, which contains the desire to immediately change majors (ED1) and feel uncomfortable with the current major (ED2). Based on the relationship between indicators and latent constructs and expected values can explain the mental health condition of students well. With this condition, it can be said that the instruments contained in the application can effectively measure the mental health condition of students and can contribute to planning and baseline data in counseling services in universities.

Conclusion
The intensity and density of the learning process in higher education make students generally experience pressure and burdens that lead to academic stress conditions. After the emergence of the Covid-19 pandemic, changes in construction and learning atmosphere also require students to make changes in the learning process at universities immediately [26,32]. These conditions add to a series of student pressures that lead to decreased productivity and academic achievement. The problem of academic stress has become one of the main focuses of the services of counselors and mental health professionals in universities.
However, with limitations and low mobility conditions during the Covid-19 pandemic, the initial assessment and monitoring of students' mental health conditions were hindered. This condition requires innovation and the development of psychological assessments that can reach students wherever they are and in a fast time. With this phenomenon, it is necessary to develop an online psychological assessment application that is mobile and accessible to students, which in this study is called POTENSIA. The test results of the application prove that the POTENSIA application is reliable in measuring the mental health condition of students, is valid based on expert judgment, and can be practically used. Another important thing about this application is that counselors in universities consider this application to be used as baseline data and an essential indicator in planning and starting counseling services in universities.