Author, (publication year), country | Sample size, sampling method, response rate | Population characteristics | mhealth app | Assessment tool, number of questions, type of domains (number of questions, n) | Validation |
---|---|---|---|---|---|
Interactive apps | |||||
Chiang et al. [11], (2023), Taiwan | n = 20, convenient sampling | Mean age 21.1 ± 2.51 years | Healthcare CEO application catered to the needs of type 1 diabetes patients transitioning from adolescent to young adulthood | 7th Edition of the Questionnaire for User Interaction Satisfaction (QUIS). 19 questions, 5-point Likert scale. 7 domains- overall user response (5), interface (2), learning (2), multimedia (3), content (5), system performance (1) and online consultation (1). Additional one open ended questions | No |
Bosse et al.[12], (2022), United States | n = 31, convenient sampling | 55% female, mean age 42.2 years (range 22–69 years) | Boulder Care. To provide patient centred tele-health to opioid use disorder patients | Researchers developed questionnaire. 24 questions, Likert scale 1 (not) to 5 (completely) and another one 0 (not at all) to 10 (extremely). 5 dimensions- comfort, interest and recommendation (3), usability, appeal and lifestyle fit (3), helpfulness of current app features (6),usefulness of proposed app features (5), likeliness of using proposed features (7). Researcher developed interview guide, 7 questions | No |
Jaffar et al. [13], (2022), Malaysia | n = 10, convenient sampling | 100% female, mean age 28.9 ± 3.1 years | Kegel exercise pregnancy training (KEPT) app to empower pregnant women to adhere to pelvic floor muscle training to improve urinary incontinence | Validated forward and backwards translation to Malay version of mHealth Application Usability Questionnaire (MAUQ) interactive version. 21 questions Likert scale of 1 to 7. 3 domains- ease of use and satisfaction (8), system information arrangement (6) and usefulness (7) | Yes |
Jiang et al. [14], (2022), China | n = 15, convenient sampling | 53% female, mean age 42.3 ± 17.4 years | Alfafa app to provide warfarin dose adjustment remotely | Researcher developed questionnaire based on System Usability Scale (SUS) in Chinese version. 14 questions, Likert scale of 1 to 5. 3 domains- demographic (4), usability (8), learnability (2) | No |
Lee et al. [15], (2022), South Korea | n = 31, convenient sampling, 83.8% (initial 37) | 100% female, mean age 32.94 ± 3.2 years | SPWW app to provide prenatal education and enhance self-care practice for Korean pregnant women at work | Validated SUS. 10 questions, Likert scale of 1 (strongly disagree) to 5 (strongly agree) and 4 open-ended questions | Unclear |
Rezaee et al. [16], (2022), Iran | n = 25, convenient sampling | 100% female | CaRA app to educate breast cancer patients to improve their resilience | SUS. 10 questions, Likert scale of 1 (strongly disagree) to 5 (strongly agree) | No |
Kooij et al. [17], (2021), Netherlands | N = 39, convenient sampling, 94.9% | 77% female, mean age 62.2 ± 6.7 years | COPD app. 8-week health and self-management program | Total 21 questions, 18 questions using Likert scale 1 (totally disagree) to 7 (totally agree), 1 multiple answers questions, 1 open ended question and 1 overall satisfaction question on a scale of 1 (not satisfied) to 10 (very satisfied). 5 domains- usability (2), lung attack action plan (3), information (10), overall satisfaction and improvement (2), video consultation (4) | Unclear |
Francis et al. [18], (2020), Australia | n = 22, convenient sampling, 37% (initial 59) | 50% female, aged 12 to 18 years | CyFi Space. To support social connectedness (interact with peers via LIveWire chatroom) and wellbeing of young people living with cystic fibrosis | Validated questionnaire adapted from Cai et al. [51] and Wood et al. [52]. 16 questions, Likert scale 1 (strongly disagree) to 7 (strongly agree). 2 domains-usability (7) and acceptability (9). Mixed method with interview via online on use of the app, positive and negative experiences using the app and recommendation to improve the app | Yes |
Rudolf et al. [19], (2019), Germany | N = 27, convenient sampling, 74.1% | 14 female, 11 male, mean age 16 ± 3 years | KiOAPP app. Self-management app for cystic fibrosis in adolescent and young adults | SUS translated from English to German and self-developed questionnaire on application usage and satisfaction. 10 questions from SUS, Likert scale 1 (decline very much) to 5 (agree very much) and 15 questions (4 questions on frequency, 2 questions on free text, 9 questions using likert scale 1 (agree) to 4 (do not know) | Unclear |
Støme et al. [20], (2019), Norway | N = 12, convenient sampling, 91.7% | 83.3% female, mean age 65 years (ranging from 61 to 70 years) | Vett app. Behavioural change and habit formation to achieve goal for osteoarthritis patients | User satisfaction questions. 10 questions, Likert scale 0 (complete disagreement) to 100 (complete agreement). 2 domains- technical feasibility (usability) (4) and user satisfaction (utility) (6) | No |
Bauer et al. [21], (2018), United States | n = 18, convenient sampling, 94.4% | 59% female. 35% aged 25–34 years | Ginger.iO app. Collaborative care program for people with depression and anxiety | Developer’s product feedback survey, 20 questions, 7 questions using Likert scale 6-point from strongly disagree to strongly agree and 13 questions to measure technology obtrusiveness using Likert scale 7-point | No |
Casida et al. [22], (2018), United States | n = 18, convenience sampling, 88.9% | Patients, 100% male and caregivers, 87.5% female | VAD Care app. Self-management for left ventricular assist device | Researcher developed App Evaluation Questionnaire, 14 questions using Likert scale 1 (strongly disagree) to 5 (strongly agree) and 1 open ended question. 3 domains—acceptability (5), usability (6), competency (3) | No |
Liu et al. [23], (2018), United States | N = 16, convenient sampling, 100% | Median age 58 (IQR 36–80) years | eCO app. Management of hypertension and diarrhoea among ovarian cancer patients | Derived from SUS and validated using cognitive interview, 17 questions, Likert scale 1 (strongly disagree) to 4 (strongly agree). 3 domains- usability, usability of the features, how eCo made in relation to the trial | Yes |
Chen et al. [24], (2017), Malaysia | n = 28, purposive sampling, 100% | University students, 89.3% female, mean age 22.0 ± 0.9 years | Food app. Food diary mobile application | Modified the validated TAM, 29 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree). 8 domains—perceived ease of use, perceived usefulness, perceived enjoyment, attitude towards food app, social influence, intention to use, system quality, and smartphone experience and 2 open ended questions for problems or issues encountered and recommendation to improvise the app | No |
Al Ayubi et al. [25], (2014), United States | N = 14, convenient sampling, 92.9% | 76.9% females, age range from 24 to 45 years | PersonA app. Physical activity promotion app | Questionnaire adapted from TAM, PSSUQ and Nielsen’s attribute of usability, 11 questions, Likert scale 1 (totally disagree) to 5 (totally agree), 5 domains- learnability, efficiency, memorability, error recovery, and satisfaction | No |
Standalone Apps | |||||
Alali et al. [26], (2022), Saudi Arabia | n = 146, snowball random sampling | 92.5% female, 80.2% age < 40 years | Mawid app.For users to book, cancel and/or reschedule appointments at primary healthcare centres and referral appointments, COVID-19 risk assessment tool | Researchers developed questionnaire. Validated by 3 experts and reliability test with 5 participants. 5 questions, Likert scale 1 (difficult) to 5 (very easy). 1 domain- ease of use | Yes |
Akmal Muhammad et al. [27], (2021), Malaysia | n = 10, convenient sampling, 100% | Parents of 4 to 6 years old children. 100% female, mean age 37.1 ± 3.45 years | Gigiku Sihat, diet and oral health application for parents or guardians of preschool children | ‘Skala Kebolehgunaan Aplikasi Mudah Alih’ (SKAMA), the translated and validated Malay version of the SUS questionnaire, 10 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree). 3 domains- effectiveness, efficiency and user satisfaction | Yes |
Chen et al. [28], (2021), China | n = 88, convenient sampling | 28% female, mean age 60 ± 9.9 years | iCARE app to facilitate behavioural modification and medication adherence among patients with coronary heart disease | Modified Health Information Technology Usability Evaluation Scale (Health-ITUES). 20 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree). 4 domains- impact (3), perceived usefulness (9), perceived ease of use (5), user control (3) | Yes |
Chulasai et al. [29], (2021), Thailand | n = 19, purposive sampling | 31.6% female, mean age 20.42 ± 1.46 years | Quit with US app to provide smoking cessation assistance to young adults aged 18 to 24 years | Developed based on Technology Acceptance Model (TAM) and SUS. 28 questions, Likert scale 1 (the lowest) to 5 (the highest). 3 domains- satisfaction of design (9), satisfaction of content (11) and confidence (8) | Yes |
Chumkasian et al. [30], (2021), Australia | n = 94, convenient sampling, 79% (initial n = 119) | 53.2% female, 49.31 ± 18.08 years | Eye Donor Aust App for eye donation among Australians, to provide person-centred and high quality information to empower people to register as an eye donor | Adapted and validated Mobile Health App Usability Questionnaire (m-MAUQ). 15 questions, Likert scale 1 (strongly disagree) to 7 (strongly agree). 3 domains- ease of use and satisfaction (9), usefulness in obtaining information (3) and system information arrangement (3) | Yes |
Hsia et al. [31], (2021), United States | n = 30, convenient sampling | 86.7% female, mean age 42.8 ± 14.4 years | ASTHMAXcel mobile application to provide education and personalized approach in managing asthma patients | Adapted standardized questionnaire. 8 questions, Likert scale of 1 (strongly disagree) to 5 (strongly agree). 6 domains- understanding of information, comprehensiveness, comfort level, general satisfaction and ease of use and technology specific (2) | No |
Tonga et al. [32], (2021), Turkey | N = 20, convenient sampling, 85% | 94.1% female, median age 48 (IQR 39–61) years | MarHand TherapyApp. Hand exercise prescription form for rheumatoid arthritis patients | SUS and adapted Usefulness, Satisfaction and Ease to Use Questionnaire (USE) Questionnaire, 10 questions for SUS, Likert scale 1 (strongly disagree) to 5 (strongly agree). 10 questions for USE, Likert scale 1 (strongly disagree) to 5 (strongly agree). 2 domains- ease of use (5) and satisfaction (5). Mixed method as interview for qualitative, 12 questions | No |
Valente et al. [33], (2021), Brazil | n = 36, rational choice sampling | 55.5% female, mean age 51 years (range from 22–69) | GlaucoCheck app to provide education to improve knowledge and facilitate treatment for patients with glaucoma | SUS. 10 questions, Likert scale of 1 (completely disagree) to 5 (completely agree) | No |
Adu et al. [34], (2020), Australia | n = 50, convenient sampling, 82% | 39% female, mean age 49.29 ± 12.74 years | My Care Hub (MCH) app, evidence-based support and education to promote self-management behavioural change in Type 1 and Type 2 diabetes patients | Adapted from USE, TAM and SUS,18 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree). 3 domains- ease of use/intelligibility/satisfaction (7), value (7) and intention for use and recommendation (4). Mixed method. Researcher developed interview guide | No |
Ji et al. [35], (2020), Canada | N = 102, random sampling, 70.6% | 65.3% female. Mean age 38.5 ± 16.7 years | Keenoa app. Artificial intelligence image based dietary assessment app and food journal | SUS, 10 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree) and additional 3 questions | Unclear |
Marques et al. [36], (2020), Brazil | N = 15, convenient sampling, 100% | 60% female, mean age 50.8 ± 14.4 years | PedCare app. Foot care app for diabetes patients | Smartphone Usability Questionnaire (SURE), 31 questions, Likert scale 1 (inadequate) to 4 (totally adequate) and not applicable (NA) | Unclear |
Sung et al. [37], (2020), South Korea | N = 70, convenient sampling, 62.9% | 83% female | App to inform medical record changes | Modified SUS, 10 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree) | No |
Battineni et al. [38], (2019), Italy | Phase 1, n = 13; phase 2, n = 15, convenient sampling, 100% | Phase 1: staffs and university students Phase 2 seafarers | Wellness on ship (WOS) app. Physical education for seafarers | Researcher designed survey, 9 questions. Likert scale 0 (very unsatisfied) to 5 (very satisfied). 3 domains- usability (3), feasibility (4) and satisfaction (2) | No |
Zhou et al. [39], (2019), United States | N = 15, randomly selected from 104 patients who expressed interest | 46.7% female, mean age 35.3 ± 15.24 years | PittPHR app. Personal health record app to manage personal health data | Post-Study System Usability Questionnaire (PSSUQ), 19 questions, Likert scale 1 (strongly agree) to 7 (strongly disagree) | No |
Ambrosini et al. [40], (2018), Australia | n = 68, convenient sampling, 73.5% | 82% female, mean age 31 years | Easy Diet Diary app., dietary assessment tool | Experience using the app, 10 questions using Likert scale (strongly disagree, disagree, undecided, agree or strongly agree) and 2 open-ended questions. 4 domains- ease of use, learnability, convenience, and perceived accuracy | No |
Everett et al. [41], (2018), United States | N = 55, convenient sampling, 85.4% | 60% female, mean age 55.0 ± 10.6 years | Sweetch app. For prediabetes to promote adherence to physical activity and weight reduction | Adapted and validated SUS, 10 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree) | Yes |
Wu et al. [42], (2018), United States | N = 32, convenient sampling, 72% (n = 23) completed the study | N = 23, 39% female, mean age 19.7 ± 4.3 years | Dosecast app. Medication reminder to promote oral medication adherence among adolescent and young adult cancer patients | Researcher-developed smartphone application acceptability questionnaire adapted from TAM, reliability test done, 13 questions, Likert scale 1 (not at all easy) to 5 (very easy). 2 domains—perceived ease of use (6), perceived usefulness (7) | Yes |
Boisseau et al. [43], (2017), United States | N = 21, convenient sampling, 71.4% | 76.2% female, mean age 36.6 ± 10.9 years | LiveOCDFree app. For obsessive compulsive disorder to conduct exposure and response prevention program | Investigators created acceptability questionnaire, 8 questions, Likert scale 1 (very difficult to use) to 7 (very easy to use) and several open-ended questions. 5 domains—overall usability (1), rate the component of the apps (4), usefulness of the apps to manage symptom (1), recommend the app to friend (1), continue use the app (1) | No |
Boushey et al. [44], (2017), United States | n = 45, convenient sampling, 83.3% (initial n = 54) | 66.7% female, mean age 33 ± 12 years | Mobile food record (mFR) application to assess dietary intake. Capture the food with mobile phone camera to estimate the energy and nutrient intake | 19 questions, results presented in strongly agree or agree, neither agree or disagree and disagree or strongly disagree | No |
Lee et al. [45], (2017), South Korea | N = 33, convenient sampling, 63.6% | 72.7% female, mean age of male 16.9 ± 0.3 years and mean age of female 17.4 ± 0.6 years | Diet-A app. Dietary intake monitoring among adolescents | Adopted questions from previous studies, 21 questions, Likert scale 1 (totally disagree) to 5 (totally agree). 3 domains- satisfaction, convenience and efficiency | No |
Prada et al. [46], (2017), Switzerland | n = 16, convenient sampling, 75% (12 responded) | 100% female, mean age 30.5 ± 9.3 years | EMOTEO app to help borderline personality disorder patients to regulate their emotion especially when their therapist was not reachable | Researcher developed questionnaire. 16 questions, likert scale of 1 (I don’t agree) to 5 (I agree) | Yes |
Stoll et al. [47], (2017), United States | n = 132, convenient sampling | 63% female, mean age 9.65 ± 0.82 years | REACH app to provide support, prevent and early intervention to anxiety among the youth | Adapted from USE and the Reactions to Program Scale (RPS). 26 questions, Likert scale 1 (not at all) to 10 (very much). 5 domains- ease of use (11), quality of support information (3), ease of learning (4), satisfaction (4) and social acceptability (4) | Yes |
Shellmer et al. [48], (2016), United States | N = 7 adolescents, n = 9 caregivers, purposive sampling, 37.5% | 57% female adolescents and 88% female caregivers, median age for adolescents 15 (IQR 11–18) years and for caregivers 49 (42–61) years | TPP (Teen Pocket PATH) app. Medication adherence and self-management for transplanted adolescents | PSSUQ, 8 questions, Likert scale 1 (strongly agree) to 7 (strongly disagree). Mixed method as interview for qualitative questions.3 domains for interview questions- general medical management, medication tracking and help features and appearance | No |
Wilson et al. [49], (2016), Canada | N = 76, convenient sampling, 28% (n = 21) completed survey | N = 21, 47.6% female, Median age 34.7 (IQR 13) years | CANVAS app. Adverse Event Following Immunization (AEFI) reporting of influenza vaccination | Usability Survey. 9 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree) | No |
Kenny et al. [50], (2015), Ireland | N = 43, convenient sampling, 100% | 88% female, mean age 16.0 ± 0.724 years | CopeSmart app. Foster positive mental health among adolescents | Self-report questionnaire, 16 questions, 3 domains- Usefulness ratings, App layout, Ease of use. Open-ended questions on the aspects of the app | No |