Skip to main content

Table 1 Summary of study characteristics, mHealth apps, assessment tools and validation status

From: Usability questionnaire for standalone or interactive mobile health applications: a systematic review

Author, (publication year), country

Sample size, sampling method, response rate

Population characteristics

mhealth app

Assessment tool, number of questions, type of domains (number of questions, n)

Validation

Interactive apps

 Chiang et al. [11], (2023), Taiwan

n = 20, convenient sampling

Mean age 21.1 ± 2.51 years

Healthcare CEO application catered to the needs of type 1 diabetes patients transitioning from adolescent to young adulthood

7th Edition of the Questionnaire for User Interaction Satisfaction (QUIS). 19 questions, 5-point Likert scale. 7 domains- overall user response (5), interface (2), learning (2), multimedia (3), content (5), system performance (1) and online consultation (1). Additional one open ended questions

No

 Bosse et al.[12], (2022), United States

n = 31, convenient sampling

55% female, mean age 42.2 years (range 22–69 years)

Boulder Care. To provide patient centred tele-health to opioid use disorder patients

Researchers developed questionnaire. 24 questions, Likert scale 1 (not) to 5 (completely) and another one 0 (not at all) to 10 (extremely). 5 dimensions- comfort, interest and recommendation (3), usability, appeal and lifestyle fit (3), helpfulness of current app features (6),usefulness of proposed app features (5), likeliness of using proposed features (7). Researcher developed interview guide, 7 questions

No

 Jaffar et al. [13], (2022), Malaysia

n = 10, convenient sampling

100% female, mean age 28.9 ± 3.1 years

Kegel exercise pregnancy training (KEPT) app to empower pregnant women to adhere to pelvic floor muscle training to improve urinary incontinence

Validated forward and backwards translation to Malay version of mHealth Application Usability Questionnaire (MAUQ) interactive version. 21 questions Likert scale of 1 to 7. 3 domains- ease of use and satisfaction (8), system information arrangement (6) and usefulness (7)

Yes

 Jiang et al. [14], (2022), China

n = 15, convenient sampling

53% female, mean age 42.3 ± 17.4 years

Alfafa app to provide warfarin dose adjustment remotely

Researcher developed questionnaire based on System Usability Scale (SUS) in Chinese version. 14 questions, Likert scale of 1 to 5. 3 domains- demographic (4), usability (8), learnability (2)

No

 Lee et al. [15], (2022), South Korea

n = 31, convenient sampling, 83.8% (initial 37)

100% female, mean age 32.94 ± 3.2 years

SPWW app to provide prenatal education and enhance self-care practice for Korean pregnant women at work

Validated SUS. 10 questions, Likert scale of 1 (strongly disagree) to 5 (strongly agree) and 4 open-ended questions

Unclear

 Rezaee et al. [16], (2022), Iran

n = 25, convenient sampling

100% female

CaRA app to educate breast cancer patients to improve their resilience

SUS. 10 questions, Likert scale of 1 (strongly disagree) to 5 (strongly agree)

No

 Kooij et al. [17], (2021), Netherlands

N = 39, convenient sampling, 94.9%

77% female, mean age 62.2 ± 6.7 years

COPD app. 8-week health and self-management program

Total 21 questions, 18 questions using Likert scale 1 (totally disagree) to 7 (totally agree), 1 multiple answers questions, 1 open ended question and 1 overall satisfaction question on a scale of 1 (not satisfied) to 10 (very satisfied). 5 domains- usability (2), lung attack action plan (3), information (10), overall satisfaction and improvement (2), video consultation (4)

Unclear

 Francis et al. [18], (2020), Australia

n = 22, convenient sampling, 37% (initial 59)

50% female, aged 12 to 18 years

CyFi Space. To support social connectedness (interact with peers via LIveWire chatroom) and wellbeing of young people living with cystic fibrosis

Validated questionnaire adapted from Cai et al. [51] and Wood et al. [52]. 16 questions, Likert scale 1 (strongly disagree) to 7 (strongly agree). 2 domains-usability (7) and acceptability (9). Mixed method with interview via online on use of the app, positive and negative experiences using the app and recommendation to improve the app

Yes

 Rudolf et al. [19], (2019), Germany

N = 27, convenient sampling, 74.1%

14 female, 11 male, mean age 16 ± 3 years

KiOAPP app. Self-management app for cystic fibrosis in adolescent and young adults

SUS translated from English to German and self-developed questionnaire on application usage and satisfaction. 10 questions from SUS, Likert scale 1 (decline very much) to 5 (agree very much) and 15 questions (4 questions on frequency, 2 questions on free text, 9 questions using likert scale 1 (agree) to 4 (do not know)

Unclear

 Støme et al. [20], (2019), Norway

N = 12, convenient sampling, 91.7%

83.3% female, mean age 65 years (ranging from 61 to 70 years)

Vett app. Behavioural change and habit formation to achieve goal for osteoarthritis patients

User satisfaction questions. 10 questions, Likert scale 0 (complete disagreement) to 100 (complete agreement). 2 domains- technical feasibility (usability) (4) and user satisfaction (utility) (6)

No

 Bauer et al. [21], (2018), United States

n = 18, convenient sampling, 94.4%

59% female. 35% aged 25–34 years

Ginger.iO app. Collaborative care program for people with depression and anxiety

Developer’s product feedback survey, 20 questions, 7 questions using Likert scale 6-point from strongly disagree to strongly agree and 13 questions to measure technology obtrusiveness using Likert scale 7-point

No

 Casida et al. [22], (2018), United States

n = 18, convenience sampling, 88.9%

Patients, 100% male and caregivers, 87.5% female

VAD Care app. Self-management for left ventricular assist device

Researcher developed App Evaluation Questionnaire, 14 questions using Likert scale 1 (strongly disagree) to 5 (strongly agree) and 1 open ended question. 3 domains—acceptability (5), usability (6), competency (3)

No

 Liu et al. [23], (2018), United States

N = 16, convenient sampling, 100%

Median age 58 (IQR 36–80) years

eCO app. Management of hypertension and diarrhoea among ovarian cancer patients

Derived from SUS and validated using cognitive interview, 17 questions, Likert scale 1 (strongly disagree) to 4 (strongly agree). 3 domains- usability, usability of the features, how eCo made in relation to the trial

Yes

 Chen et al. [24], (2017), Malaysia

n = 28, purposive sampling, 100%

University students, 89.3% female, mean age 22.0 ± 0.9 years

Food app. Food diary mobile application

Modified the validated TAM, 29 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree). 8 domains—perceived ease of use, perceived usefulness, perceived enjoyment, attitude towards food app, social influence, intention to use, system quality, and smartphone experience and 2 open ended questions for problems or issues encountered and recommendation to improvise the app

No

 Al Ayubi et al. [25], (2014), United States

N = 14, convenient sampling, 92.9%

76.9% females, age range from 24 to 45 years

PersonA app. Physical activity promotion app

Questionnaire adapted from TAM, PSSUQ and Nielsen’s attribute of usability, 11 questions, Likert scale 1 (totally disagree) to 5 (totally agree), 5 domains- learnability, efficiency, memorability, error recovery, and satisfaction

No

Standalone Apps

 Alali et al. [26], (2022), Saudi Arabia

n = 146, snowball random sampling

92.5% female, 80.2% age < 40 years

Mawid app.For users to book, cancel and/or reschedule appointments at primary healthcare centres and referral appointments, COVID-19 risk assessment tool

Researchers developed questionnaire. Validated by 3 experts and reliability test with 5 participants. 5 questions, Likert scale 1 (difficult) to 5 (very easy). 1 domain- ease of use

Yes

 Akmal Muhammad et al. [27], (2021), Malaysia

n = 10, convenient sampling, 100%

Parents of 4 to 6 years old children. 100% female, mean age 37.1 ± 3.45 years

Gigiku Sihat, diet and oral health application for parents or guardians of preschool children

‘Skala Kebolehgunaan Aplikasi Mudah Alih’ (SKAMA), the translated and validated Malay version of the SUS questionnaire, 10 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree). 3 domains- effectiveness, efficiency and user satisfaction

Yes

 Chen et al. [28], (2021), China

n = 88, convenient sampling

28% female, mean age 60 ± 9.9 years

iCARE app to facilitate behavioural modification and medication adherence among patients with coronary heart disease

Modified Health Information Technology Usability Evaluation Scale (Health-ITUES). 20 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree). 4 domains- impact (3), perceived usefulness (9), perceived ease of use (5), user control (3)

Yes

 Chulasai et al. [29], (2021), Thailand

n = 19, purposive sampling

31.6% female, mean age 20.42 ± 1.46 years

Quit with US app to provide smoking cessation assistance to young adults aged 18 to 24 years

Developed based on Technology Acceptance Model (TAM) and SUS. 28 questions, Likert scale 1 (the lowest) to 5 (the highest). 3 domains- satisfaction of design (9), satisfaction of content (11) and confidence (8)

Yes

 Chumkasian et al. [30], (2021), Australia

n = 94, convenient sampling, 79% (initial n = 119)

53.2% female, 49.31 ± 18.08 years

Eye Donor Aust App for eye donation among Australians, to provide person-centred and high quality information to empower people to register as an eye donor

Adapted and validated Mobile Health App Usability Questionnaire (m-MAUQ). 15 questions, Likert scale 1 (strongly disagree) to 7 (strongly agree). 3 domains- ease of use and satisfaction (9), usefulness in obtaining information (3) and system information arrangement (3)

Yes

 Hsia et al. [31], (2021), United States

n = 30, convenient sampling

86.7% female, mean age 42.8 ± 14.4 years

ASTHMAXcel mobile application to provide education and personalized approach in managing asthma patients

Adapted standardized questionnaire. 8 questions, Likert scale of 1 (strongly disagree) to 5 (strongly agree). 6 domains- understanding of information, comprehensiveness, comfort level, general satisfaction and ease of use and technology specific (2)

No

 Tonga et al. [32], (2021), Turkey

N = 20, convenient sampling, 85%

94.1% female, median age 48 (IQR 39–61) years

MarHand TherapyApp. Hand exercise prescription form for rheumatoid arthritis patients

SUS and adapted Usefulness, Satisfaction and Ease to Use Questionnaire (USE) Questionnaire, 10 questions for SUS, Likert scale 1 (strongly disagree) to 5 (strongly agree). 10 questions for USE, Likert scale 1 (strongly disagree) to 5 (strongly agree). 2 domains- ease of use (5) and satisfaction (5). Mixed method as interview for qualitative, 12 questions

No

 Valente et al. [33], (2021), Brazil

n = 36, rational choice sampling

55.5% female, mean age 51 years (range from 22–69)

GlaucoCheck app to provide education to improve knowledge and facilitate treatment for patients with glaucoma

SUS. 10 questions, Likert scale of 1 (completely disagree) to 5 (completely agree)

No

 Adu et al. [34], (2020), Australia

n = 50, convenient sampling, 82%

39% female, mean age 49.29 ± 12.74 years

My Care Hub (MCH) app, evidence-based support and education to promote self-management behavioural change in Type 1 and Type 2 diabetes patients

Adapted from USE, TAM and SUS,18 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree). 3 domains- ease of use/intelligibility/satisfaction (7), value (7) and intention for use and recommendation (4). Mixed method. Researcher developed interview guide

No

 Ji et al. [35], (2020), Canada

N = 102, random sampling, 70.6%

65.3% female. Mean age 38.5 ± 16.7 years

Keenoa app. Artificial intelligence image based dietary assessment app and food journal

SUS, 10 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree) and additional 3 questions

Unclear

 Marques et al. [36], (2020), Brazil

N = 15, convenient sampling, 100%

60% female, mean age 50.8 ± 14.4 years

PedCare app. Foot care app for diabetes patients

Smartphone Usability Questionnaire (SURE), 31 questions, Likert scale 1 (inadequate) to 4 (totally adequate) and not applicable (NA)

Unclear

 Sung et al. [37], (2020), South Korea

N = 70, convenient sampling, 62.9%

83% female

App to inform medical record changes

Modified SUS, 10 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree)

No

 Battineni et al. [38], (2019), Italy

Phase 1, n = 13; phase 2, n = 15, convenient sampling, 100%

Phase 1: staffs and university students

Phase 2 seafarers

Wellness on ship (WOS) app. Physical education for seafarers

Researcher designed survey, 9 questions. Likert scale 0 (very unsatisfied) to 5 (very satisfied). 3 domains- usability (3), feasibility (4) and satisfaction (2)

No

 Zhou et al. [39], (2019), United States

N = 15, randomly selected from 104 patients who expressed interest

46.7% female, mean age 35.3 ± 15.24 years

PittPHR app. Personal health record app to manage personal health data

Post-Study System Usability Questionnaire (PSSUQ), 19 questions, Likert scale 1 (strongly agree) to 7 (strongly disagree)

No

 Ambrosini et al. [40], (2018), Australia

n = 68, convenient sampling, 73.5%

82% female, mean age 31 years

Easy Diet Diary app., dietary assessment tool

Experience using the app, 10 questions using Likert scale (strongly disagree, disagree, undecided, agree or strongly agree) and 2 open-ended questions. 4 domains- ease of use, learnability, convenience, and perceived accuracy

No

 Everett et al. [41], (2018), United States

N = 55, convenient sampling, 85.4%

60% female, mean age 55.0 ± 10.6 years

Sweetch app. For prediabetes to promote adherence to physical activity and weight reduction

Adapted and validated SUS, 10 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree)

Yes

 Wu et al. [42], (2018), United States

N = 32, convenient sampling, 72% (n = 23) completed the study

N = 23, 39% female, mean age 19.7 ± 4.3 years

Dosecast app. Medication reminder to promote oral medication adherence among adolescent and young adult cancer patients

Researcher-developed smartphone application acceptability questionnaire adapted from TAM, reliability test done, 13 questions, Likert scale 1 (not at all easy) to 5 (very easy). 2 domains—perceived ease of use (6), perceived usefulness (7)

Yes

 Boisseau et al. [43], (2017), United States

N = 21, convenient sampling, 71.4%

76.2% female, mean age 36.6 ± 10.9 years

LiveOCDFree app. For obsessive compulsive disorder to conduct exposure and response prevention program

Investigators created acceptability questionnaire, 8 questions, Likert scale 1 (very difficult to use) to 7 (very easy to use) and several open-ended questions. 5 domains—overall usability (1), rate the component of the apps (4), usefulness of the apps to manage symptom (1), recommend the app to friend (1), continue use the app (1)

No

 Boushey et al. [44], (2017), United States

n = 45, convenient sampling, 83.3% (initial n = 54)

66.7% female, mean age 33 ± 12 years

Mobile food record (mFR) application to assess dietary intake. Capture the food with mobile phone camera to estimate the energy and nutrient intake

19 questions, results presented in strongly agree or agree, neither agree or disagree and disagree or strongly disagree

No

 Lee et al. [45], (2017), South Korea

N = 33, convenient sampling, 63.6%

72.7% female, mean age of male 16.9 ± 0.3 years and mean age of female 17.4 ± 0.6 years

Diet-A app. Dietary intake monitoring among adolescents

Adopted questions from previous studies, 21 questions, Likert scale 1 (totally disagree) to 5 (totally agree). 3 domains- satisfaction, convenience and efficiency

No

 Prada et al. [46], (2017), Switzerland

n = 16, convenient sampling, 75% (12 responded)

100% female, mean age 30.5 ± 9.3 years

EMOTEO app to help borderline personality disorder patients to regulate their emotion especially when their therapist was not reachable

Researcher developed questionnaire. 16 questions, likert scale of 1 (I don’t agree) to 5 (I agree)

Yes

 Stoll et al. [47], (2017), United States

n = 132, convenient sampling

63% female, mean age 9.65 ± 0.82 years

REACH app to provide support, prevent and early intervention to anxiety among the youth

Adapted from USE and the Reactions to Program Scale (RPS). 26 questions, Likert scale 1 (not at all) to 10 (very much). 5 domains- ease of use (11), quality of support information (3), ease of learning (4), satisfaction (4) and social acceptability (4)

Yes

 Shellmer et al. [48], (2016), United States

N = 7 adolescents, n = 9 caregivers, purposive sampling, 37.5%

57% female adolescents and 88% female caregivers, median age for adolescents 15 (IQR 11–18) years and for caregivers 49 (42–61) years

TPP (Teen Pocket PATH) app. Medication adherence and self-management for transplanted adolescents

PSSUQ, 8 questions, Likert scale 1 (strongly agree) to 7 (strongly disagree). Mixed method as interview for qualitative questions.3 domains for interview questions- general medical management, medication tracking and help features and appearance

No

 Wilson et al. [49], (2016), Canada

N = 76, convenient sampling, 28% (n = 21) completed survey

N = 21, 47.6% female, Median age 34.7 (IQR 13) years

CANVAS app. Adverse Event Following Immunization (AEFI) reporting of influenza vaccination

Usability Survey. 9 questions, Likert scale 1 (strongly disagree) to 5 (strongly agree)

No

 Kenny et al. [50], (2015), Ireland

N = 43, convenient sampling, 100%

88% female, mean age 16.0 ± 0.724 years

CopeSmart app. Foster positive mental health among adolescents

Self-report questionnaire, 16 questions, 3 domains- Usefulness ratings, App layout, Ease of use. Open-ended questions on the aspects of the app

No