Exploring User Experience and User Interface of Indonesian e-Health PeduliLindungi Mobile-Apps with MeCUE 2.0 Framework

— The Ministry of Communication and Information (KOMINFO) of Indonesia released the mobile-based e-Health app PeduliLindungi Mobile-Apps (PLMA) in April 2020. It helps the Indonesian government track and stop the COVID-19 pandemic. PLMA detects, tracks, warns, and stops Covid-19. KOMINFO requires all citizens to utilize PLMA, which has been downloaded over 10,000,000 times. However, PLMA was criticized by those who used its apps due to application errors, data breaches, and incorrect user data. 470,521 Google Play Store users rated it 3.8 on September 29, 2021. The PLMA review score suggests the application needs revision. PLMA receives concerns regarding its navigation, features, connection and performance issues, personal data security, and accessibility. The study examines PLMA's impact on application users' UX and UI. Few research has measured or evaluated PLMA UI/UX. The meCUE 2.0 framework by Minge (2020) evaluates application user experience services. It's new and extensive. MeCUE 2.0's questionnaire comprises 34 statement items. Modules I and II (Perception of quality of instrumental and non-instrumental products), III (Emotions), IV (Consequences), and V (Overall Evaluation) comprise it. This study began by translating and giving 50 respondents the meCUE 2.0 questionnaire. The PLMA UI/UX ratings were 3.17 for usefulness, 4 for usability, 3.33 for visual aesthetics, 3 for status, 3.67 for commitment, 3.67 for positive emotions, 2.67 for negative emotions, 3.67 for intention to use, 2.67 for product loyalty, and 3.67 for overall evaluation (107.00). This research contributes ideas and uses. It advises UX designers and policymakers to consider key elements when creating PLMAs.


INTRODUCTION
PeduliLindungi Mobile-Apps (PLMA) is an e-Health application that was launched in April 2020 by the Ministry of Communication and Information (KOMINFO) of the Republic of Indonesia. This application is built on mobile technology [1]. Its purpose is to assist the government in Indonesia in monitoring the Covid-19 Pandemic and preventing the disease from expanding further. PLMA is utilized to locate Covid-19, maintain a record of it, notify people about it, and halt its progression throughout the world [2], [3]. The Indonesian government made the PLMA, which is a digital shift, to stop the spread of COVID-19 in Indonesia. It is set up so that everyone in Indonesia can use it, and it is up to the government to convince people to use it. The app is also used for transportation on planes, in stores, at tourist spots, and in other public places. It is also used for transportation on land, sea, and air. To download the program, vaccination certificates are also given out. The government has several of rules or policies about how to use the PeduliLindungi, and all government departments in Indonesia are required to do so. The application has to be made because there needs to be a lot of community tracking.  [1] There have been over ten million downloads of PLMA, and KOMINFO has instructed all residents to use this app. According to the reports, there have been over ten million downloads [4]. The info above shows that PeduliLindungi is user-based. Over the past year, the line has grown. There is room for growth between 4-5 million period users (July-December 2020) and 32.85 million period users (July-September 2021). This line shows that people are quickly becoming more confident in PeduliLindungi. The public trusts the PeduliLindungi app, as shown by these numbers. During the COVID-19 outbreak, people know that PeduliLindungi is important.
However, users of PLMA's applications complained about issues like application errors, data leaks, and incorrect user data. Additionally, as of the 29th of September, 2021, it had received 3.8 stars out of 5 from 470,521 reviews on the Google Play Store. The PLMA evaluation score indicates that the program could use some tweaks. In addition, PLMA receives feedback about the site's poor usability, unclear features, connection and performance issues, insecure storage of confidential information, and inaccessibility [2]. The PLMA faces several challenges, including people's trust in the application, the application's function in daily life, and the government's ability to devise a strategy that will convince people to use the application [1]. In Indonesia, the PeduliLindungi app has gotten the most feedback from its users, with application mistakes reaching 52%, data errors reaching 28%, and data leakage reaching 20%. People talk about data mistakes, application errors, and data leaks the most. These errors are caused by user data, which can lead to things like vaccine license data that didn't come out, wrong data on people who might get a vaccine, and errors that affect users, like missing the train or waiting in long lines. Because of the mistake, the app can't be used [1]. Fig. 3. Technical problems is referred to as PLMA [1] Several previous studies related to PLMA, but very lack studies on PLMA user experience and user interface, previous related studies were PeduliLindungi's COVID-19 Treatment Success (Indonesian Case Study) [1], User Satisfaction Analysis of PeduliLindungi App Using EUCS Method [5], PeduliLindungi App Users Multinomial Naive Bayes-SMOTE Fine-Grained Sentiment Analysis [6], Integration and Interoperability Issues with PeduliLindungi Data and Software Architecture Refactoring [7], Aspects of the PeduliLindungi App User's Goals, Procedures, Tools, and Surroundings [8], PeduliLindungi User Satisfaction Research [9], Google Play PeduliLindungi sentiment analysis using the Random Forest Algorithm with SMOTE [10], Case Study of Jakarta University Students' Use of the PeduliLindungi App to Prevent COVID-19 [11], PeduliLindungi, an Indonesian tracking app, sheds light on an integrated model of tracking apps [12], Factors That Influence Indonesians' Plans to Use the PeduliLindungi App During COVID-19 [13], Sentiment Analysis Machine Learning Comparison PeduliLindungi Applications [14], Binary Sentiment Reviews: Support Vector Machine vs. Naive Bayes Classifier for the PeduliLindungi App [15], Support Vector Machine and Naive Bayes Algorithm-Based Particle Swarm Optimization Analysis of Google Play User Reviews for PeduliLindungi [16], and Acceleration of Pedulilindungi's Popularity Among the Public in Relation to the Corona Virus (Covid-19) [17].
The study aims to examine into assessing PLMA which concentrates on the user experience (UX) or user interface (UI) for app users. Few studies have examined or measuredI/UX in PLMA, but the numbers are still very small and limited. Several previous studies related to the user experience perspective and the PLMA user interface include Research by Bianca, et al., 2023[18], During the Covid-19 pandemic, a study was done on how users felt about the quality of a program based on the dimensions of electronic service quality (E-Service Quality). This research involved 198 PLMA users in the Java-Bali area and was processed using PLS-SEM. QuantitativeTquantitative cross-sectional design is used. The results proved that PeduliLindungi's service quality dimensions were well-  [20] for app user experience evaluation. The design of this framework is novel and comprehensive. MeCUE 2.0 has a 34-item assessment. Modules I and II (perception of instrumental and noninstrumental product quality), Module III (Emotions), Module IV (Consequences), and Module V (Overall Evaluation). This study began by translating and distributing the meCUE 2.0 assessment to 50 people. Thüring and Mahlke's CUE model is the basis for the meCUE architecture, which disentangles practical and aesthetic evaluations of quality. Interactional characteristics have a direct impact on usability and utility, while sensory input and cognitive processing are essential for percept formation, and this is the reason why its suitable for user experience measurement [20]- [22].
The findings of this study have significance not only conceptually but also practically. For instance, it recommends to UX designers and government officials what to consider while developing PLMAs.

II. RESEARCH METHOD
The research stages of measuring the user interface and user experience in the m-health application the PeduliLindungi application are described in detail as follows:

D. Data Processing
After distributing the meCUE2.0 questionnaire, it was then processed through several stages, namely: 1. Checking data on Google Forms. The data used is data that has been collected in Google Forms. After that, the data is recorded. 2. Preprocessing Data. Data cleaning which includes data completion, duplicate data removal, data blanking, and noise generation is performed as part of data preparation to convert raw data into data ready for later processing. In this study, data deletion was performed if one of the attributes was left blank or there was noise in the data.

E. Data Analysis
In conducting data analysis from the meCUE2.0 questionnaire, there are several steps. The following are some of the steps in data analysis: 1. Data Collection. Obtaining the data to be studied is the first step in the data analysis process.

F. Draw a Conclusion
Conclusions are drawn by describing the results of the research only to answer research questions.

III. RESULT AND DISCUSSION
The results of research on the exploration of the user experience and user interface for the PeduliLindungi Apps are presented as follows:

A. Characteristics of Respondents
The characteristics of the demographic group in this study show that 60% of the meCUE2.0 respondents are men and 40% are women. Only 2% of the people who answered are between the ages of 15 and 19, 72% are between the ages of 21 and 29, and 26% are older than 30. 28 percent of respondents work for private companies, 28 percent are company owners or entrepreneurs, 22 percent are students, 14 percent work for the government, and the last 8 percent do not have a job. The table below shows the demographics of meCUE 2.0 respondents:

B. Data Processing
Data processing is done by processing the results of the respondent's questionnaire obtained by using the validity and reliability tests as follows:

Validity Testing
The purpose of this validity test is to find out whether the items on the questionnaire are capable of being used in research. This study used a total of 50 respondents using the Aiken formula. In testing each criterion in the items in the table above, valid results were obtained so that the questionnaire was ready to be used in data collection.

Reliability Testing
After carrying out the validity test, the next step is to carry out a reliability test. The reliability test is carried out to find out if the questionnaire is truly trustworthy. If the Cronbach alpha value in each module is > 0.4, then the questionnaire is considered reliable [26]. The results of the reliability test can be seen in the table below: With a value of > 0.624, the Indonesian version of the meCUE 2.0 framework is thought to be reliable based on the statistical results of all 50 items and 50 interviewees. The results also show that the instrument is reliable because the Cronbach alpha value is greater than 0.8 and the score doesn't change much and stays the same. All indicators can be considered valid if their validity score is greater than 0.624, but an indicator of usability with several 0.481 has the lowest score. With a value of 0.843, the most important number comes from the negative emotion indicator.

C. Analysis of MeCUE 2.0
The result of the user experience research with MeCUE 2.0 frameworks was shown below: Below is the graphics module I: has 2 indicators namely Usefulness and Usability. Based on the research results, the Usefulness score on a scale of 1-5 is 3.17 and the Usability value is 4.00. That is, users, provide an assessment that the product being tested has a fairly good level of Usefulness, but there is still room for improvement. Meanwhile, a fairly high Usability value indicates that the product is easy for users to use. Therefore, to improve the user experience of the product, it is necessary to make improvements to the Usefulness aspect so that the product can better meet user needs while maintaining a high level of usability. Module II in user experience research with MeCUE 2.0 has 3 indicators namely Visual Aesthetics, Status, and Commitment. Based on the results of the study, the Visual Aesthetics score on a scale of 1-5 was 3.33, the Status value was 3.00, and the Commitment value was 3.67. That is, the user gives an assessment that the tested product has a fairly good level of Visual Aesthetics, but there is still room for improvement. In addition, the product is also considered to have a fairly good status by users. However, for the Commitment aspect, users give a relatively high rating, indicating a tendency to engage more deeply with the product.

Module II
In the context of product development, these results indicate that it is necessary to make improvements to the Visual Aesthetics aspect to increase product attractiveness and improve user experience. In addition, it is also necessary to pay attention to maintaining or enhancing the product's brand image through the Status aspect, and utilizing the potential of the Commitment aspect as a binding factor for users to the product.

Module III
Module III has 2 indicators, namely: a. Positive Emotions: 3.67 b. Negative Emotions: 2.67 Below is graphics module III That is, users provide an assessment that the experience of using the product can trigger positive emotions in users with a relatively high value. Meanwhile, a lower Negative Emotions value indicates that the product tends not to cause significant negative emotions in users. In product development, these results indicate that the product can lead to a positive user experience, and needs to be maintained or improved. In addition, it is necessary to avoid factors that can cause negative emotions in users so that the experience of using the product becomes more optimal.

Module IV
Module IV has 2 indicators, namely: a. Intention to use: 3.67 b. Product loyalty: 2.67 Below is the graphics module IV the value on a scale of 1-5 is 3.67, and the Product loyalty value is 2.67. That is, users provide an assessment that they are likely to want to use the product in the future (Intention to use) with a relatively high value. However, a lower product loyalty value indicates that users tend not to have a strong level of loyalty to the product.
In product development, these results indicate that the product has the potential to become the user's top choice in the future, but efforts need to be made to strengthen user loyalty to the product so they don't switch to other products.

Module V
Module V has 1 indicator, namely: a. Overall Evaluation: 107.00 Below is graphics module III Fig. 11. Module V Module V in user experience research with MeCUE 2.0 has one indicator, namely Overall Evaluation. Based on the results of the study, the Overall Evaluation score was 107.00. That is, users give an overall positive assessment of the products tested in the study. These results indicate that the product provides a good and satisfying user experience. In product development, these results can be a reference for product developers to maintain or improve product quality to meet user needs and expectations. In addition, positive ratings from users can also be a source of motivation for product developers to continue developing and improving product quality in the future.
The results of user experience research with MeCUE 2.0 show that users consider the product to have a fairly good level of usability and use (scores 4.00 and 3.17 in Module I). However, users consider the value of satisfaction with this product to be not high (there is no value for this module). In addition, users also give relatively low scores for the Visual Aesthetics, Status, and Commitment aspects in Modules II and III. This shows that there needs to be an improvement in these aspects so that the product is more attractive and has the status desired by the user.
The results of the research on Module IV show that users have the intention to use the product (value 3.67), but the level of loyalty to the product is still lacking (value 2.67). This could indicate that the user may be using the product for a while, and is still considering looking for alternative products.
The results of the research on Module V show an Overall Evaluation score of 107, which indicates that overall, the product is considered good by users. However, keep in mind that the results of this study are based on only one product and a limited sample. Therefore, the research results cannot be used as a general reference for different products or user populations

D. Discussions
In the results of user experience research with MeCUE 2.0, several things need to be considered in interpreting these results.
In Module I, users give quite good scores on the Usefulness and Usability aspects, which indicate that the product is considered quite useful and easy to use. However, there is no value for the Satisfaction aspect, so no conclusions can be drawn regarding the level of user satisfaction with the product.
In Modules II and III, users give relatively low scores for the Visual Aesthetics, Status, and Commitment aspects, indicating that the product needs to be improved on these aspects to make it more attractive and have the status desired by users. A low Visual Aesthetics value can have an impact on reducing user interest in the product, while a low Status and Commitment value can indicate that the product is not considered important or has the desire to be known by users.
In Module IV, users have the intention to use the product, but the level of loyalty to the product is still lacking. This indicates that the product may only be used for a while and is still considering alternative products.
In Module V, the Overall Evaluation value indicates that overall the product is considered good by users. However, keep in mind that the results of this study are based on only one product and a limited sample, so the results cannot be used as a general reference for different products or user populations.
In interpreting the research results, it should also be noted that MeCUE 2.0 is only one of the user experience measurement methods that can be used, and each method has its advantages and disadvantages. Therefore, it is necessary to carry out further research using different methods or using MeCUE 2.0 on a wider population of users and different products to obtain more comprehensive results.
From the results of the user experience research analysis with MeCUE 2.0, several significant discussions can be carried out.
First, the research shows that users prioritize the Usefulness and Usability aspects in measuring the user experience of the product. Therefore, in the next product development, it is necessary to pay attention to these aspects to ensure that the product can meet the needs and is easy for users to use.
Second, low scores on the Visual Aesthetics, Status, and Commitment aspects indicate that improvements need to be made to the appearance and image of the product to make it more attractive and have the status desired by the user. This can be done by involving graphic designers and branding consultants in product development. Third, a relatively high Intention to use value indicates that the product has the potential to be widely used by users. However, the low level of loyalty indicates that a better marketing and product development strategy is needed to increase user loyalty to the product.
Fourth, keep in mind that the results of this study are based on only one product and a limited sample. Therefore, the results cannot be generalized to different products or user populations. Therefore, it is necessary to carry out further research using different methods or using MeCUE 2.0 on a wider population of users and different products to obtain more comprehensive results.
Fifth, the research results can be used as a reference in further product development. In product development, it is necessary to consider aspects that are considered important by users, such as Usefulness, Usability, Visual Aesthetics, Status, and Commitment, to improve product quality and meet user needs.

IV. CONCLUSION
This study aims to explore and evaluate the user experience of PeduliLindungi Mobile-Apps (PLMA). Based on the results of the analysis and discussions that have been carried out, several important conclusions can be drawn from the PLMA user experience research with MeCUE 2.0. First, the Usefulness and Usability aspects are important factors in measuring the user experience of the product, so in further PLMA development, it is necessary to pay attention to these aspects to ensure the product can meet the needs and is easy for users to use. Second, aspects of Visual Aesthetics, Status, and Commitment need to be considered in PLMA development so that it is more attractive and has the status desired by users. This can improve user experience and strengthen PLMA's brand image. Third, a relatively high Intention to use value indicates the potential for PLMA to be widely used by users, but a low level of loyalty indicates the need for a better marketing and development strategy for PLMA to increase user loyalty to the PLMA. Fourth, the results of this study can only be used as a reference in further PLMA development, because the results are based on one product and a limited sample. Therefore, it is necessary to carry out further research using different methods or using MeCUE 2.0 on a wider population of users and different products to obtain more comprehensive results. Fifth, MeCUE 2.0 can be used as an effective tool in measuring user experience at PLMA, by providing comprehensive information about aspects that are considered important by users.