Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Development and real-life use assessment of a self-management smartphone application for patients with inflammatory arthritis. A user-centred step-by-step approach

  • Catherine Beauvais ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    catherine.beauvais@aphp.fr

    Affiliation Service de Rhumatologie, Hôpital Saint Antoine, Assistance Publique Hôpitaux de Paris (AP-HP), Sorbonne Université, Paris, France

  • Thao Pham,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliation Service de Rhumatologie, Hôpital Sainte Marguerite, Aix Marseille Univ, Assistance Publique Hôpitaux de Paris (APHM), Marseille, France

  • Guillaume Montagu,

    Roles Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Département de Recherche, Unknowns, Conseil en Stratégie et Innovation, Paris, France

  • Sophie Gleizes,

    Roles Data curation, Investigation, Visualization, Writing – review & editing

    Affiliations Département de Recherche, Unknowns, Conseil en Stratégie et Innovation, Paris, France, Laboratoire d’Anthropologie Sociale (LAS), Collège de France/EHESS/EPHE, Paris, France

  • Francesco Madrisotti,

    Roles Data curation, Investigation, Visualization, Writing – review & editing

    Affiliations Département de Recherche, Unknowns, Conseil en Stratégie et Innovation, Paris, France, Centre de National de la Recherche Scientifique (CNRS), Laboratoire CERMES3 (CNRS-EHESS-INSERM), Université de Paris, Paris, France

  • Alexandre Lafourcade,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Institut Pierre Louis d’Epidémiologie et de Santé Publique, Sorbonne Université, INSERM, Paris, France, Département de Santé Publique, Centre de Pharmacoépidémiologie (Cephepi), CIC-1422, Hôpital Pitié Salpêtrière, Sorbonne Université, APHP, Paris, France

  • Céline Vidal,

    Roles Investigation, Writing – review & editing

    Affiliation Clinique Beau Soleil, Montpellier, France

  • Guillaume Dervin,

    Roles Investigation, Writing – review & editing

    Affiliation Clinique Juge, Institut Médical Sport Santé Marseille, Marseille, France

  • Pauline Baudard,

    Roles Investigation, Writing – review & editing

    Affiliation Service de Rhumatologie, Centre Hospitalo-Universitaire Caen, Caen, France

  • Sandra Desouches,

    Roles Investigation, Writing – review & editing

    Affiliation Service de Rhumatologie, Hôpital Saint Antoine, Assistance Publique Hôpitaux de Paris (AP-HP), Sorbonne Université, Paris, France

  • Florence Tubach,

    Roles Methodology, Software, Writing – review & editing

    Affiliations Institut Pierre Louis d’Epidémiologie et de Santé Publique, Sorbonne Université, INSERM, Paris, France, Département de Santé Publique, Centre de Pharmacoépidémiologie (Cephepi), CIC-1422, Hôpital Pitié Salpêtrière, Sorbonne Université, APHP, Paris, France

  • Julian Le Calvez,

    Roles Software, Writing – review & editing

    Affiliation Unknowns, Conseil en Stratégie et Innovation, Paris, France

  • Marie de Quatrebarbes,

    Roles Software, Writing – review & editing

    Affiliation Unknowns, Conseil en Stratégie et Innovation, Paris, France

  • Delphine Lafarge,

    Roles Investigation, Writing – review & editing

    Affiliation Association France Spondyloarthrite (AFS), Tulle, France

  • Laurent Grange,

    Roles Investigation, Writing – review & editing

    Affiliation AFLAR Association Française de Lutte Anti rhumatismale (AFLAR), Paris, France

  • Françoise Alliot-Launois,

    Roles Investigation, Writing – review & editing

    Affiliation AFLAR Association Française de Lutte Anti rhumatismale (AFLAR), Paris, France

  • Henri Jeantet,

    Roles Conceptualization, Methodology, Software, Writing – review & editing

    Affiliation Unknowns, Conseil en Stratégie et Innovation, Paris, France

  • Marie Antignac,

    Roles Formal analysis, Methodology, Writing – review & editing

    Affiliations Service de Pharmacie, Hôpital Saint Antoine, Assistance Publique Hôpitaux de Paris (AP-HP), Sorbonne Université, Paris, France, Equipe d’Épidémiologie Intégrative, INSERM U 970, PARCC, Paris, France

  • Sonia Tropé,

    Roles Investigation, Project administration, Writing – review & editing

    Affiliation Association Nationale de Défense Contre l’Arthrite Rhumatoïde (ANDAR), Paris, France

  • Ludovic Besset,

    Roles Conceptualization, Methodology, Software, Supervision, Writing – review & editing

    Affiliation Unknowns, Conseil en Stratégie et Innovation, Paris, France

  • Jérémie Sellam,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Service de Rhumatologie, Hôpital Saint Antoine, Assistance Publique Hôpitaux de Paris (AP-HP), Sorbonne Université, Paris, France, Centre de Recherche Saint-Antoine (CRSA), INSERM UMRS_938, FHU PaCeMM, Paris, France

  •  [ ... ],
  • on behalf of Therapeutic patient education group of the French Society of Rheumatology and Club Rhumatismes et Inflammations

    Membership of Therapeutic patient education group of the French Society of Rheumatology and Club Rhumatismes et Inflammations are provided in the Acknowledgments.

  • [ view all ]
  • [ view less ]

Abstract

Background

Mobile health applications (apps) are increasing in interest to enhance patient self-management. Few apps are actually used by patients and have been developed for patients with inflammatory arthritis (IA) treated with disease-modifying anti-rheumatic drugs which use entails risk of adverse effects such as infections.

Objective

To develop Hiboot, a self-management mobile app for patients with IA, by using a user-centred step-by-step approach and assess its real-life use.

Methods

The app development included first a qualitative study with semi-guided audiotaped interviews of 21 patients to identify the impact of IA on daily life and patient treatments practices and an online cross-sectional survey of 344 patients to assess their health apps use in general and potential user needs. A multidisciplinary team developed the first version of the app via five face-to-face meetings. After app launch, a second qualitative study of 21 patients and a users’ test of 13 patients and 3 rheumatologists led to the app’s current version. The number of app installations, current users and comments were collected from the Google Play store and the Apple store.

Results

The qualitative study revealed needs for counselling, patient–health professional partnership, and skills to cope with risk situations; 86.8% participants would be ready to use an app primarily on their rheumatologist’s recommendation. Six functionalities were implemented: a safety checklist before treatment administration, aids in daily life situations based on the French academic recommendations, treatment reminders, global well-being self-assessment, periodic counselling messages, and a diary. The Hiboot app was installed 20,500 times from September 2017 to October 2020, with 4300 regular current users. Scores were 4.4/5 stars at Android and iOS stores.

Conclusion

Hiboot is a free self-management app for patients with IA developed by a step-by-step process including patients and health professionals. Further evaluation of the Hiboot benefit is needed.

Introduction

Mobile health applications (mhealth apps) have undergone significant development in recent years and are of increasing interest and usefulness to help patients manage their chronic inflammatory arthritis (IA) [13]. IA—that is, rheumatoid arthritis (RA) and spondyloarthritis (SpA) including psoriatic arthritis (PsA)—represents painful chronic conditions impairing quality of life and work capacities. Disease-modifying anti-rheumatic drugs (DMARDs) are used to control IA disease activity, reduce functional disability and improve prognosis. They include methotrexate, biologic agents such as tumor necrosis factor (TNF) alpha blockers, and Janus-kinase (JAK) inhibitors. They are increasing in availability (more than 15 DMARDs in France) and have a wide variety of targets and modes of administration [48].

Most mhealth apps for IA described in the literature focus on symptom tracking, including disease activity, pain and fatigue [912], as well as physical activity [13, 14], treatment reminders and exchange functionalities [15]. Systematic reviews of IA apps have shown that most apps have been designed without involving patients in their development and that healthcare providers have rarely contributed [9, 10, 15]. The European Alliance of Associations for Rheumatology (EULAR) recently issued “points to consider,” emphasizing that participation of patients and health professionals (HPs) was essential in the content, development and evaluation of mhealth apps [16]. Another challenge in mhealth apps relates to real-life use because very few apps found in the literature are still available at stores after their launch [9], which suggests potential discrepancy between users’ interests and the app design or content. The number of current installations and app users is rarely reported, although usage represents a basic assessment of their impact [13].

Few apps for IA patients have targeted patient education [9, 10, 15]. Patient education, including e-education, is advocated to develop self-care and improve patients’ autonomy over their own health and treatment [17]. Apps may be appropriate tools for self-management such as medications management, problem-solving, and care coordination [3] or to offer a holistic approach of self-management [18]. An app providing information to help patients be more aware of their medications in daily life has not been addressed in IA. Patients receiving DMARDs are at risk of adverse events, including excess risk of infection, noted more in RA [1921] than SpA [22], in particular because of co-medication with glucocorticoids and/or high disease activity. Measures patients can take to decrease these risks include vaccinations [23], self-referral and DMARD interruption in some situations [2429] such as surgery, dental care or pregnancy, which patients need to discuss with HPs. An app helping patients to adopt appropriate behaviours with risk situations [30, 31] could be of interest. It could also help maintain patients’ skills after face-to-face patient education sessions because patient education has been found effective in the short term only [32].

In this context, we developed a self-management mhealth app called Hiboot for patients with IA treated with DMARDs. The development was designed to involve patients and HPs, including the app concept, preliminary studies to explore patients’ needs and understand the overall aspects of their daily lives, and use a step-by-step approach by adjusting the app in line with users’ feedback. Evaluation was planned by collecting the number of app installations, regular users and scores and comments at app stores.

Materials and methods

Design of the Hiboot app development

The development was promoted by the French Society of Rheumatology and managed by a steering committee of 3 rheumatologists (JS, TP, CB), a member of a patient association (ST), a methodologist (FT) and members of a digital company including 3 anthropology researchers involved in qualitative studies (SG, FM, GM) (Fig 1). The development steps included a mixed-method qualitative–quantitative study (step 1) to obtain the first version of the app (step 2) and the app launch (step 3). After the app launch, users’ tests and a second qualitative study were performed (steps 4 and 5), which led to the current version (step 6).

Step 1. Mixed-method qualitative–quantitative study.

In the first qualitative study (May-June 2016), patients were recruited by the 3 rheumatologists of the steering committee and enrolled on a voluntary basis from 2 public hospitals and 2 private practices in France. Before the beginning of the study, the purposeful sampling methodology was used to obtain a variety of predetermined patient profiles by age, sex, disease duration, socio-professional status, type of IA (RA, SpA, PsA), type of DMARD (methotrexate or biologics) and number of previous DMARDs used. Assessment of medication adherence was not an eligibility criterion, nor was previous use of an mhealth app. After the interviews had begun, the sample was completed with the progression of the data collection, according to the approach of the grounded theory model [33]. A standardized semi-structured interview schedule (Appendix 1 in S1 File) explored 3 main areas: (1) daily life with IA, (2) practices of pharmacological and non-pharmacological treatments, and (3) the patient’s social and work relationships. Eligibility criteria were adults (aged ≥18 years) with a diagnosis of IA according to the rheumatologist’s opinion [3436] who received methotrexate and/or biologic DMARDs (bDMARDs), were followed as outpatients or inpatients and were fluent in French. Exclusion criteria were conditions that could alter patients’ understanding such as cognitive impairment and psychiatric disorders. Two anthropologists (GM, FM) conducted the interviews in the patient’s usual environment (i.e. preferentially in their home). Interviews were audiotaped and transcribed verbatim. All data were de-identified to ensure confidentiality. Transcripts were analysed by using an ethnographic approach based on the grounded theory [33]. Patient enrolment was stopped at data saturation (i.e., when adding more participants did not provide any new information).

Data analysis and the consolidated criteria for reporting qualitative research criteria (COREQ) [37] are in Appendix 2 in S1 File.

The quantitative study (June-August 2016) was an online cross-sectional survey. The questionnaire was developed by the steering committee based on the study purpose. The survey content was drawn from the qualitative study with a focus on patients’ practices with their treatments and the use of apps.

The broad areas of the survey were demographics, difficulties and problems encountered in daily life, needs for advice, participants’ smartphone and mhealth apps use and motivation for an mhealth app for their IA, the app’s potential content, and non-exhaustive issues in daily life. Inclusion criteria were a diagnosis of IA and treatment with DMARDs. The survey was posted on the 3 patient-association partner websites and Facebook accounts or were proposed anonymously by the investigating rheumatologists belonging to the 2 investigating hospital rheumatology departments and the 2 private offices, who provided the Internet link to patients. To check the inclusion criteria, patients were invited to state the name of their DMARDs. At analysis, the questionnaires with no available DMARD names were deleted. The quantitative descriptive analysis was performed with R Core Team (2017) (R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria).

Associations between participants’ willingness to use an mhealth app (grouped in 2 classes: “totally and rather agree” vs “rather not and not at all agree”) and participants’ characteristics were calculated by using Chi-square test or Fisher’s exact test for categorical variables and Wilcoxon rank test for quantitative variables according to the statistical distribution.

Step 2. Development of the first version of the app by a multidisciplinary team (September 2016-May 2017).

The team (including the steering committee) consisted of 7 rheumatologists, 3 patient association representatives and 5 members of the digital company and worked in 5 face-to-face meetings. The team discussed the implications of the preliminary studies (i.e. step 1) for the app development, and patient feedback helped define the look, features and navigation.

Step 3. Launch of the first version of the app (May 2017- January 2018).

The launch involved a multimodal strategy including communication to patients, rheumatologists and health professionals. The first version of the app was released in May 2017.

Step 4. Users’ tests and development of the current version.

Two rounds of users’ tests were conducted. The first round in September 2018 consisted of in-depth interviews of 7 patients of different profiles (current users or those who dropped out) and 3 rheumatologists, who recommended or not the app to their patients. The participants were recruited in the same way as in step 1. The second round of users’ tests was conducted in December 2019, including 6 patients, 4 recruited by the rheumatologists and 2 recruited by Stephenson, an agency specialized in market analysis. The aim was to collect the patients’ opinions on the app’s features, interface and navigation and to investigate rheumatologists’ opinions. Patient interviews took place in a neutral environment (café, workplace) or by phone. Rheumatologist interviews were by phone. The interviews were conducted with a predefined schedule. The main topics of the patient interviews were their comments on the use and functionalities of the app. The main topics of the rheumatologist interviews were their own knowledge of the app, their own feedback on the app and patient feedback, and barriers to recommending the app.

Step 5 was a second qualitative study, including RA patients receiving all types of DMARDs, added 2 years after the app’s launch (March 2019- February 2020) to better understand patient needs following the availability in France of new DMARDs. Some of these new DMARDs, the targeted synthetic DMARDs (tsDMARDs), involved daily administration that could require modifying the app features. The schedule was built after a literature review of new issues related to tsDMARDs [38, 39]. The addressed domains were history of the patient pathway, the patient–doctor relationship, decision-making, and medication daily management (Appendix 3 in S1 File). Recruitment sampling, data collection and data analysis were conducted using the same methods as in Step 1.

Step 6. Current version delivery.

The current version, called Hiboot+, was constructed during and/or after steps 4 and 5 with the inclusion of additional features and content, and released in December 2019.

App assessment

The app’s use was assessed by collecting data from app stores: Google play store for Android operating systems (https://play.google.com/console/) and Apple app store for iOS systems (https://appstoreconnect.apple.com/login). Both stores provide analytics features to monitor the performances of apps. The collected data included the number of installations from October 2017 to September 2020, defined as monthly installations minus monthly uninstallations; the number of regular users, defined as people whose app was in use at least once a month; the number and type of features used from June to November 2020; and the type of requests for daily situations sought via the app from March to November 2020. Scores (0 to 5-star rating) were collected at the Google Play and Apple stores in January 2021. A content analysis of comments on the stores was conducted from launch to April 2021 and classified according to satisfaction/non-satisfaction, difficulties and missing functionalities.

Results

Qualitative studies

The first qualitative study enrolled 21 patients. Although the second qualitative study, also involving 21 patients, was conducted after the app launch, the emerging themes were similar. Therefore, results are presented together to avoid redundancy. Patients were mainly female (33/42), with median age 51 years (17–82): 33 had RA, 7 SpA and 2 PsA. Eleven received methotrexate monotherapy and 31 bDMARDs or tsDMARDs monotherapy or combined therapy with methotrexate (demographics in Appendix 4 in S1 File).

Summary of the key emerging themes

Short quotes are available in Text box 1 and full quotes are in Appendix 5 in S1 File. The thematic analysis revealed 3 themes: (1) living with IA as a career, (2) acquisition of skills and lay knowledge and (3) patient treatment appropriation practices. Sub-themes (in italics) were identified and deduced for the app, each sub-theme corresponding to one or more of the app’s functionalities (Text box 1).

Text box 1. Implications of qualitative studies for the app development

1. Living with IA as a “career”.

At the onset of the disease, participants reported a “career” starting with the search for causes, looking for information and looking for the right diagnosis and the right doctor.

IA management needed a close joint effort and a patient–rheumatologist partnership. Most patients developed routines and habits with their treatment and could face secondary lack of efficacy. The onset of side effects or disease complications could occur at any point in the disease course. Patients had to cope with the unpredictability of these events and to handle situations in daily life such as infections or planned surgery. Patients needed to know what the appropriate emergency responses were and what situations required the rheumatologist’s intervention or advice.

2. Patient skills and lay knowledge.

To manage the situations at risk throughout their career, patients needed to develop various types of skills, some of which were related, as follows. To navigate the healthcare system: know which healthcare professional to consult, when and how often; to deal with information sources: know where to look for information, how to identify the most relevant sources; to know how to collaborate with the rheumatologist and other HPs: know what to expect and ask from them; experiments with the disease and treatment: patients were taking control over their medications via various adjustments and experiences such as changing their DMARD dosage or administration intervals on their own initiative or trying alternative medicine or food exclusions; and adaptation skills: to deal with the disease and complications, know how to cope with ordinary infections and other situations, manage minor treatment.

3. Patient treatment appropriation practices.

Three additional sub-themes emerged:

The treatment ritual: patients ritualized their subcutaneous administration. Such rituals represented a reflexive moment, only dedicated to themselves and their disease:

Potential conflict between safety and adherence. Rituals tended to improve adherence but could lead to lack of concern about safety recommendations because of habits, over-confidence, and neglect of situations at risk.

Influence of the mode of administration. The daily administration of tsDMARDs (JAK inhibitor) did not modify patients’ perception as compared with bDMARDs, but patients’ opinions depended on their experience with RA (severity, activity, control).

Implications for the app development

Six functionalities were implemented in the app: 5 from the first qualitative study: a safety checklist before treatment administration, aids to self-management in daily life or with risk situations, treatment reminders, global well-being self-assessment, and periodic counselling messages; and an additional one from the second qualitative study: the diary was added to note comments, appointments and other treatments.

Quantitative study

The quantitative study included 344 patients, and 331 questionnaires were complete for analysis: 82.8% of patients were female, 55.7% had RA, and 62.6% received methotrexate and 70.4% bDMARDs (Table 1); 238 (78%) patients had a smartphone and 191 (80.9%) were using apps, but only 61 (32.3%; 18.4% overall) were using mhealth apps (Table 2). Whether or not they had used apps, 70.5% of the patients reported questions or difficulties with their treatment and 67.5% had needed help or advice. The main issues were infections, vaccines and surgery, whereas storage/travel, dental care or missed doses were rarely reported. Fatigue and the wish to stop treatment were themes related to patients’ way of coping with their disease.

thumbnail
Table 1. Quantitative study.

Patient characteristics: demographics, clinical features and other information (n = 344). The quantitative study was carried out from June to August 2016.

https://doi.org/10.1371/journal.pone.0272235.t001

thumbnail
Table 2. Quantitative study: Smartphone use, difficulties encountered and information needs in daily life (n = 344).

https://doi.org/10.1371/journal.pone.0272235.t002

Among app users who answered the question (n = 211), 86.8% (n = 177) would willingly use an app to manage their treatment (51% strongly agreed, 35.8% rather agreed) and 64.4% (n = 112) would accept the app only on their rheumatologist’s recommendation (Table 3). Participants interested in the app were more frequently younger than those who would not use the app [age 48.4 years (± 13 SD) vs 54.0 years (± 12 SD), Wilcoxon rank sum test p<0.05], not members of a patient association (66.7% vs 45.4%, chi-square test p<0.05) and lived in medium-sized than other sized cities (Fisher exact test p<0.01). We found no association with other sociodemographic characteristics, level of education, type/duration of arthritis or knowledge.

The app would be used (Table 3) to find out what to do in case of risk situations (92.8%, n = 196 [strongly or rather agreed]) or to find out what symptoms would require stopping treatment (82%; n = 173). It could also be used as a treatment reminder (79.7%; n = 162), a reminder of the monitoring tests (89.9%; n = 184) or as a safety checklist before treatment administration (77%, n = 156).

thumbnail
Table 3. Quantitative study: Potential use of the app, patients’ approval1, and implications for app development2 (in italics) (n = 236).

https://doi.org/10.1371/journal.pone.0272235.t003

Development of the first version of Hiboot

The development of the app (Step 2) is presented in Text box 2.

Text box 2. Hiboot functionalities and content

Type of application.

Considering legal issues, the steering committee and the French Society of Rheumatology decided that no personal information would be collected. Consequently, the app was a self-administered app for self-management and was not registered as a medical device. Patients’ data were not to be directly communicated to rheumatologists or general practitioners, but patients could make screenshots of their app to communicate with their physician during consultations. The app was free of charge. Terms and conditions of use informed the patients of the app type and that information content intended to help in daily situations but did not provide medical advice or consultation; did not constitute personal advice, diagnosis, aid to diagnosis, treatment or aid to treatment; and did not constitute or substitute for advice, diagnosis or recommendations provided by a competent HP. The promotor (i.e., French Society of Rheumatology) was mentioned.

Hiboot features and content

The choice was for a “companion” called Hiboot (Owl), whose interface should not appear too medical. The owl evokes a watchful animal and because of its small size, it could be a companion (Hiboot screenshots in Fig 2 and in Appendix 1 in S2 File). The potential use by patients with hand deformity was addressed during the conception.

thumbnail
Fig 2. HIBOOT home page.

Republished from a screenshot of the application home page under a CC BY license, with permission from the French society of rheumatology original copyright 2022.

https://doi.org/10.1371/journal.pone.0272235.g002

Safety checklist before treatment administration intended to warn patients about situations that could contraindicate treatment intake (Appendix 2 in S2 File). Six types of risk situations were identified. If one situation was quoted, an explanation of the situation was provided and the patient was invited to not take the treatment and to contact his/her doctor.

Aid in daily life situations including risk situations (examples in Appendix 3 in S2 File). Situations requiring patient information were identified from the quantitative study and from a previous work on patients’ safety skills by the patient education study group of the French Society of Rheumatology [40, 41]. They were incorporated into the app by keywords commonly used by the public (Appendix 3 in S2 File). The aids were aimed as warnings to patients to promote self-referral to HPs: information included a general presentation of the situation and advice on what to do and when/how to refer to the rheumatologist, hospital team or the family doctor. A “patient phrasing” was built by consensus to be understandable by patients and the public.

For each situation, 3 information materials were selected: summary of product characteristics, material validated by national health authorities [4245], and guidelines of the French Society of Rheumatology and the Club Rhumatismes et Inflammations (CRI). [2428, 46]. DMARDs and IA treatments that did not have guidelines from the CRI could not be implemented in the app. Therefore, the app content was free from commercial, unverified or non-consensual sources among rheumatologists. Details on the app’s information sources are in Appendix 4 in S2 File.

Educational messages (examples in Appendix 5 in S2 File) consisted of general information on the disease, healthy lifestyle, daily life matters and symptomatic treatments of IA. The topics were extracted from the websites of the partner patient organisations and/or directly from the patients/participants in the team and from previous work on essential knowledge for patients with IA [47].

Treatment reminders were used to remind about the app, medications use and the safety checklist. The app users had to input their treatment to receive the reminders.

Self-assessment involved a simple question, “How do you feel today?”, which was asked at the time of the reminder and checklist and answered on a 5-point Likert scale, from 1, badly, to 5, perfectly well. The answers were stored only in the app.

The compete files of the checklist, situational aids and educational messages are available upon request.

Implementation technology

The Hiboot app is a hybrid app. Development was made with the javascript front-end framework AngularJS, then packaged by using Cordova. We used an Ionic library to create the user interface. The Ionic library runs on a wide range of Android and iPhone devices. Content of the app was managed by a headless content management system named Prismic. User data and parameters are stored within the app.

The launch campaign

The launch campaign (Step 3) included emails to the rheumatologists on the French Society of Rheumatology mailing list, monthly newsletters from the CRI network, printed flyers and posters for outpatient clinics in private rheumatology offices and departments. Advertising was produced for the front page of the French Society of Rheumatology website and for social networks (Facebook, Twitter @AppliHiboot) as well as on patient association websites and Facebook/Twitter accounts. A video was posted on YouTube. The first version was launched in May 2017, with small changes (bug corrections) made until January 2018 (Fig 1).

Users’ tests

Demographics of participants in the users’ tests and quotes (Step 4) are in Appendices 1 to 4 in S3 File. We interviewed 13 patients (7 using the app, 2 who dropped out and 4 non-users) and 3 rheumatologists. Patient interviews were from 90 to 120 min and rheumatologist interviews from 30 min to 1 hr.

The tests showed 2 usage types: (1) regular use by patients who were regularly using the app and asked for more features and (2) occasional use for specific questions requiring quick answers. The features valued by participants were the reminder system, the situational aids and the messages. However, some patients found the checklist and treatment recalls too repetitive and preferred optional use. The navigation system also had to be improved. Some patients also wanted more holistic self-management by using a personal diary.

Rheumatologists found it difficult to identify the scope of the app to recommend it routinely because it requires a proactive attitude and personal experience of its content.

Current version

The current version (Step 6, Text box 2) was launched in December 2019 on iOs and January 2020 on Android, with bug corrections until July 2020 (Fig 1). It implemented additional DMARDs including anti-IL-17 blockers, JAK inhibitors and biosimilars, updated information on all DMARDs, and added functionalities such as a diary to note medical appointments, other personal medications, comments, life events and memos to prepare for medical consultations. A website was developed [48] to present the situational aids, the other functionalities remaining only available on the app.

Assessment of the use of the app

The app was installed 20,500 times from October 2017 to September 2020 from both stores (Android and iOS) with an increasing curve (Fig 3). The number of app removals was 2870. The number of regular users was 4328 (i.e. approximately 21% of the installations).

thumbnail
Fig 3. Number of installations and mean number of regular users* from October 2017 to September 2020.

* Regular user: individual using the app once a month or more (data from Android + iOS).

https://doi.org/10.1371/journal.pone.0272235.g003

From March to November 2020, users made 18,000 requests about daily life situations (Table 4). Most requests corresponded to those identified in preliminary studies, such as infections, dental care, and storage/travel. However, the first troublesome symptoms searched in the app were skin allergies, injection site reactions and tattoos and piercing, which had not been identified before development. Questions on libido ranked in sixth position. This topic had been added after users’ feedback, as had thermal/spa therapy. In March 2020, a peak in use concerned COVID-19. Information on COVID-19 could not be pursued on Android after June 2020 because of cancellation by Google with the claim that Hiboot was not a government app.

thumbnail
Table 4. Information on daily situations/symptoms and patient queries from the app from March to November 2020.

Data collected in Google analytics.

https://doi.org/10.1371/journal.pone.0272235.t004

The most-used functionalities were the checklist (3.97 views/month/user), diary (3.18 views/month/user) and daily/at risk situations (3.38 views/month/user) (S4 File). The scores at both stores have been 4.4/5, with most 4 and 5 (Appendix 1 in S5 File). The analysis of the 124 comments on the app stores (Appendix 2 in S5 File) showed 47 overall positive comments with particular “likes” for the app initiative, the reminders, the checklist and advice. The 8 overall negative comments were mainly related to the bugs in the app updates. Fifty-five bugs were reported or complained about: 19 bugs were reported on the reminder system, particularly on Android where 15 bugs owed to the battery optimisation function, which could block reminders and 10 bugs were reported about the checklist in iOS, which had a presentation defect. These bugs were corrected. Fourteen users regretted missing features such their treatment not included in the app. A few users wanted to be able to print/save the diary content.

Discussion

Here we report the development of the Hiboot app dedicated to self-management for patients with IA. The design and process followed a step-by-step strategy matched with patients’ opinions by using 2 qualitative studies, one quantitative study and users’ tests to improve versions over time. The final device contains 6 functionalities, including a safety checklist, aids for everyday life and risk situations, treatment reminders, simple self-assessment, educational messages, and a diary to note comments, appointments and other medications. Hiboot is a free app. Real-life use assessment showed a still-increasing number of current users, 4300 in September 2020, and good scores at app stores.

From the preliminary studies (step 1), features that needed to be included in the app were information seeking, the HP–patient relationship, and assistance in everyday situations. Maintenance of patient skills in risk situations could conflict with good adherence to DMARDs by habits and over-confidence. Therefore, medication reminders and patient self-assessment at the time of ritualizing DMARD self-administration could constitute additional incentives to use the safety checklist. However, the systematic use of the checklist was counterproductive for some patients as users’ tests showed, so the checklist was secondarily made optional.

Preliminary studies showed that reliable information was important for patients, which was consistent with other studies [49, 50]. The app was then designed to be free from commercial or non-consensual sources among rheumatologists so that they could recommend the app. Besides self-management of potential risks, other features were found relevant to implement related to experiments currently practiced by people with IA (e.g., missed doses or the wish to stop or taper DMARDs). Patients’ concerns represented a wide range of everyday situations, some of which emerged after the launch and included minor but embarrassing skin problems or more intimate sexual issues.

To our knowledge, no self-management app of this nature is currently available for adult patients with IA, particularly with respect to medication management. The design, process and evaluation of the app can be compared to those described by Cai et al. [18], who developed an app for young patients with juvenile idiopathic arthritis and followed a user-centred approach with qualitative in-depth studies.

The Hiboot app meets 6 of the 10 EULAR recommendations for mhealth app development for people with IA [16]: to date, scientifically justifiable, user acceptable and evidence-based information (recommendation 1); relevant and tailored to individual needs (2); involvement of patients and HPs in design and development (3); transparency of the app’s developer, funding source, content validation process, version updates and data ownership (4); attention to data protection (5); and facilitation of patient–healthcare provider communication (6).

The app content covers many aspects of self-management, with a large part devoted to treatment self-management skills [30, 40, 41]. With reference to the well-established definition of self-management [51, 52] that is, “the ability of the individual to manage symptoms, treatment, lifestyle changes and psychosocial and cultural consequences of health conditions”, Hiboot meets the objective of helping IA people with their treatments, symptoms and information needs and provides healthy lifestyle and daily life messages.

The Hiboot app does not monitor patient-related outcomes as described in other apps [12]. Self-assessment in the app is a simple question, “How do you feel today”, to be eventually shared with the rheumatologist or physician. Studies have shown that patients favoured self-monitoring of health or disease activity [49, 50, 53] and many people with IA would agree to share their mobile app data for research purposes or regularly enter data [50]; however, only 10 patients in our survey suggested patient-related outcome self-monitoring, so it was not retained in the app. Regardless, no specific question was asked about this feature in the survey, which might have underestimated patients’ interests.

Hiboot provides treatment recalls similar to the literature [15]. Including reminders was of interest because medication adherence in IA needs to be improved [54, 55] and the benefit of reminders has been shown by short message service systems in RA [56] or by apps for other chronic conditions [57].

The collection of the number of installations and regular users at stores is a strength because this was seldom described in the literature; other strengths are the collection of comments at stores, used functionalities and people’s queries. The 20,500 installations may seem small as compared with the IA prevalence in France, estimated at 400,000 people for both RA and SpA [58, 59], so approximately 5% of patients installed the Hiboot app. However, this number seems substantial as compared with other apps for people with IA dedicated to physical activity: among 3 apps identified by Bearne et al. [13], one was installed by 1000 people with RA and one by 500 people; information was not available for the last one. The number of installations is also to be compared with the still low use of mhealth apps: 4.1% of the IA population used mhealth apps in Germany [50] and 4.6% of RA patients in France [60]. This observation may indicate that the number of people who installed the Hiboot app was close to the whole population who already use mhealth apps (i.e, 5%). The app’s life is longer than most published apps: some have shown a rapid decrease in use over a 4-week period [12]; 75% people had stopped using them after 3 months [49] and only 5% of apps for rheumatic and musculoskeletal diseases were still available 2 years after their launch [9].

With regard to EULAR recommendations, 4 recommendations have not been met so far. Hiboot is not a medical device collecting data for research or self-monitoring of disease activity. As mentioned above, this aspect did not emerge from our preliminary studies but may have been underestimated. Although comments at stores did not reveal negative comments (apart from reports or complaints about “bugs”), a further study will be necessary to assess the benefit/risks of the app’s use (EULAR recommendation 6) and the cost–benefit balance (recommendation 10). The design of the app could not meet recommendation 9 on providing a social network, which is only an optional recommendation. Accessibility of people across ages and abilities (recommendation 8) is a challenge in developing apps: this has been well quoted by rheumatologists about the difficulty in recommending the app. Not checking health literacy was also a limitation, because another study mentioned this as an important barrier to the use of apps [50].

For users’ assessment, we looked for only star ratings and comments at stores. We are aware that this is very broad information that poorly reflects the true app quality as compared with other evaluation tools, the Mobile Application Rating Scale (MARS) being the most commonly used [61, 62]. The star systems may over-rate the app quality for two thirds of users [63]. Although the MARS tool has a user version [62], collecting spontaneous and unselected users’ comments appeared of interest. The comments showed that Hiboot was not spared from “bugs” and had to be revised, particularly on the Android platform. In all cases, future assessment of the benefit of the app as to its features, safety and adherence will be needed.

In conclusion, the Hiboot app is a free app dedicated to self-management for patients with IA. The app has good usage and was developed according to international recommendations for people with IA. Further studies will be needed to assess the benefits of this app.

Declarations

Ethics and consent to participate.

Participants of the qualitative research were informed of the study objectives and schedule and expressed their non-opposition according to local recommendations. The research was approved by an ethics committee (Comité de Protection des Personnes, no. 19.07.02.68617) and was declared to the commission for data collection, the Commission Informatique et Liberté (no. 2,214,586). Regarding the quantitative survey, patients who were given the internet link by the rheumatologists were orally informed of the objectives of the study. Their participation was not monitored. Therefore, approval by an ethics committee was not requested according to local recommendations.

Supporting information

S2 File. Hiboot features and content examples.

https://doi.org/10.1371/journal.pone.0272235.s002

(DOCX)

S4 File. Number of views/users*/months from June to November 2020.

https://doi.org/10.1371/journal.pone.0272235.s004

(DOCX)

S5 File. Scoring and comments at app stores.

https://doi.org/10.1371/journal.pone.0272235.s005

(DOCX)

Acknowledgments

We thank all patients who participated the qualitative and quantitative studies; patients and rheumatologists who participated in the users’ tests and app improvements; Mme Nathalie Robert from the association Spondyl(O)action for users’ feedback; Mahed Iqbal (Unknowns) and Alexandre Galatioto (Unknowns) for development contribution; Damien Carnet (ANDAR) for posting the quantitative study questionnaire; Laura Smales for reviewing the English version; and Frédéric Lioté, Hôpital Lariboisière, Paris, who contributed to patient recruitment in the second qualitative study.

Membership of Therapeutic patient education group of the French Society of Rheumatology and Club Rhumatismes et Inflammations are available at www.cri-net.com and https://sfr.larhumatologie.fr/.

References

  1. 1. World Health Organization 2016. From innovation to implementation. eHealth in the WHO European Region. http://www.euro.who.int/__data/assets/pdf_file/0012/302331/From-Innovation-to-Implementation-eHealth-Report-EU.pdf (2nd January 2020)
  2. 2. Mollard E, Michaud K. Mobile Apps for Rheumatoid Arthritis: Opportunities and Challenges. Rheum Dis Clin North Am. 2019;45:197–209. pmid:30952393
  3. 3. Mollard E, Michaud K. Self-Management of Rheumatoid Arthritis: Mobile Applications. Curr Rheumatol Rep. 2020;23:2. pmid:33244621
  4. 4. Daien C, Hua C, Gaujoux-Viala C, Cantagrel A, Dubremetz M, Dougados M et al. Update of French Society for Rheumatology Recommendations for Managing Rheumatoid Arthritis. Joint Bone Spine 2019;86:135–150. pmid:30315988
  5. 5. Smolen JS, Landewé R, Bijlsma J, Burmester G, Dougados M, Kerschbaumer A et al. EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2019 update. Ann Rheum Dis 2020;79:685–699. pmid:31969328
  6. 6. Wendling D, Lukas C, Prati C, Claudepierre P, Gossec L, Goupille P et al, 2018 update of French Society for Rheumatology (SFR) recommendations about the everyday management of patients with spondyloarthritis. Joint Bone Spine 2018;85:275–284. pmid:29407043
  7. 7. van der Heijde D, Ramiro S, Landewé R, Baraliakos X, Van den Bosch F, Sepriano A et al, 2016 update of the ASAS-EULAR management recommendations for axial spondyloarthritis. Ann Rheum Dis. 2017;76:978–991. pmid:28087505
  8. 8. Gossec L, Baraliakos X, Kerschbaumer A, de Wit M, McInnes I, Dougados M et al. EULAR recommendations for the management of psoriatic arthritis with pharmacological therapies: 2019 update. Ann Rheum Dis 2020;79:680–682.
  9. 9. Najm A, Gossec L, Weill C, Benoist D, Berenbaum F, Nikiphorou E. Mobile Health Apps for Self-Management of Rheumatic and Musculoskeletal Diseases: Systematic Literature Review. JMIR Mhealth Uhealth. 2019;7:e14730. pmid:31769758
  10. 10. Luo D, Wang P, Lu F, Elias J, Sparks JA, Lee YC. Mobile Apps for Individuals With Rheumatoid Arthritis: A Systematic Review. J Clin Rheumatol. 2019;25:133–141. pmid:29933327
  11. 11. Grainger R, Townsley H, White B, Langlotz T, Taylor WJ. Apps for people with rheumatoid arthritis to monitor their disease activity: a review of apps for best practice and quality. JMIR Mhealth Uhealth 2017;5:e7. pmid:28223263
  12. 12. Seppen BF, Wiegel J, L’ami MJ, Duarte dos Santos Rico S, Catarinella FS, Franktien Turkstra1 F et al. Feasibility of Self-Monitoring Rheumatoid Arthritis With a Smartphone App: Results of Two Mixed-Methods Pilot Studies. JMIR Form Res 2020;4:e20165. pmid:32955447
  13. 13. Bearne LM, Sekhon M, Grainger R, La A, Shamali M, Amirova A et al. Smartphone Apps Targeting Physical Activity in People With Rheumatoid Arthritis: Systematic Quality Appraisal and Content Analysis. JMIR Mhealth Uhealth. 2020;8:e18495. pmid:32706727
  14. 14. Revenäs Å, Opava CH, Ahlén H, Brusewitz M, Pettersson S, Pernilla Åsenlöf P. Mobile internet service for self-management of physical activity in people with rheumatoid arthritis: evaluation of a test version. RMD Open, 2016;2:e000214. eCollection 2016. pmid:27099777
  15. 15. Knitza J, Tascilar K, Messner EM, Meyer M, Vossen D, Pulla A. German Mobile Apps in Rheumatology: Review and Analysis Using the Mobile Application Rating Scale (MARS). JMIR Mhealth Uhealth. 2019;7:e14991. pmid:31381501
  16. 16. Najm A, Nikiphorou E, Kostine M, Richez C, Pauling J, Finckh A et al. EULAR points to consider for the development, evaluation and implementation of mobile health applications aiding self-management in people living with rheumatic and musculoskeletal diseases. RMD Open. 2019 13;5:e001014. pmid:31565245
  17. 17. Zangi HA, Ndosi M, Adams J, Andersen L, Bode C, Boström C et al, EULAR recommendations for patient education for people with inflammatory arthritis. Ann Rheum Dis. 2015;74:954–62. pmid:25735643
  18. 18. Cai RA, Beste D, Chaplin H, Varakliotis S, Suffield L, Josephs F, et al. Developing and Evaluating JIApp: Acceptability and Usability of a Smartphone App System to Improve Self-Management in Young People With Juvenile Idiopathic Arthritis. JMIR Mhealth Uhealth 2017;5(8):e121. pmid:28811270
  19. 19. Singh JA, Cameron C, Noorbaloochi S, Cullis T, Tucker M, Christensen R, et al. Risk of serious infection in biological treatment of patients with rheumatoid arthritis: a systematic review and meta-analysis. The Lancet 2015; 386:258–65. pmid:25975452
  20. 20. Michaud TL, Rho YH, Shamliyan T, Kuntz KM, Choi HK. The comparative safety of tumor necrosis factor inhibitors in rheumatoid arthritis: a meta-analysis update of 44 trials. Am J Med 2014;127:1208–32. pmid:24950486
  21. 21. Sepriano A, Kerschbaumer A, Smolen J, van der Heijde D, Dougados M, van Vollenhoven R et al. Safety of synthetic and biological DMARDs: a systematic literature review informing the 2019 update of the EULAR recommendations for the management of rheumatoid arthritis. Ann Rheum Dis. 2020;79:760–770. pmid:32033941
  22. 22. Sepriano A, Regel A, van der Heijde D, Braun J, Baraliakos X, Landewé R et al Efficacy and safety of biological and targeted-synthetic DMARDs: a systematic literature review informing the 2016 update of the ASAS/EULAR recommendations for the management of axial spondyloarthritis. RMD Open. 2017 27;3:e000396. eCollection 2017. pmid:28176964
  23. 23. Furer V, Rondaan C, Heijstek MW, Agmon-Levin N, van Assen S, Bijl M et al 2019 update of EULAR recommendations for vaccination in adult patients with autoimmune inflammatory rheumatic diseases. Ann Rheum Dis 2020;79:39–52. pmid:31413005
  24. 24. Pham T, Fautrel B, Gottenberg JE, Goupille P, Hachulla E, Masson C et al Rheumatic Diseases & Inflammation Group (Club Rhumatismes et Inflammation, CRI) of the French Society for Rheumatology (Société Française de Rhumatologie, SFR). Rituximab (MabThera) therapy and safety management. Clinical tool guide. Joint Bone Spine. 2008;75 Suppl 1:S1–99.
  25. 25. Pham T, Claudepierre P, Constantin A, de Bandt M, Fautrel B, Gossec L et al. Tocilizumab: therapy and safety management. Joint Bone Spine. 2010;77 Suppl 1:S3–100. pmid:20610315
  26. 26. Pham T, Bachelez H, JM, Blacher J, Bouhnik Y, Pascal Claudepierre P et al. alpha antagonist therapy and safety monitoring. Joint Bone Spine. 2011;78 Suppl 1:15–185.
  27. 27. Pham T, Bachelez H, JM, Blacher J, Claudepierre P, Constantin A et al. Abatacept therapy and safety management. Joint Bone Spine. 2012;79 Suppl 1:3–84. pmid:22541956
  28. 28. Richez C, Morel J, Cornec D, Daïen C, Goupille P, Lazaro E et al. Practical management of patients on Janus kinase inhibitor (JAKi) therapy: Practical fact sheets drawn up by the Rheumatism and Inflammation Club (CRI), a group endorsed by the French Society for Rheumatology (SFR). Joint Bone Spine. 2019;86 Suppl 1:eS2–eS103.
  29. 29. Götestam Skorpen C, Hoeltzenbein M, Tincani A, Fischer-Betz R, Elefant E, Chambers C, et al. The EULAR points to consider for use of antirheumatic drugs before pregnancy, and during pregnancy and lactation. Ann Rheum Dis 2016;75:795–810. pmid:26888948
  30. 30. Beauvais C, Fayet F, Rousseau A, Sordet C, Pouplin S, Maugars Y et al. Efficacy of a nurse-led patient education intervention in promoting safety knowledge and skills of patients with inflammatory arthritis (IA) treated with biologics: a randomized controlled trial. Ann Rheum Dis, volume 78, supplement 2, year 2019, page A1441.
  31. 31. Gutermann L, Dumas S, Lopez-Medina C, Boissinot L, Camille Cotteret C, Perut V et al. Impact of a pharmacist-led programme on biologics knowledge and adherence in patients with spondyloarthritis. Clin Exp Rheumatol, 2020 Oct 9. Online ahead of print. pmid:33124563
  32. 32. Niederman K, Fransen J, Knols R, Uebelhart D. Gap between short and long-term effects of patient education in rheumatoid arthritis patients: a systematic review. Arthritis Rheum 2004;51:388–98. pmid:15188324
  33. 33. Charmaz K. Constructing Grounded Theory: A Practical Guide Through Qualitative Analysis. London: Sage, 2006.
  34. 34. Aletaha D, Neogi T, Silman AJ, Funovits J, Felson DT, Bingham 3rd CO et al, 2010 rheumatoid arthritis classification criteria: an American College of Rheumatology/European League Against Rheumatism collaborative initiative. Arthritis Rheum. 2010;62:2569–2581. pmid:20872595
  35. 35. Rudwaleit M, van der Heijde D, Landewé R, Listing J, Akkoc N, Brandt J et al, The development of Assessment of SpondyloArthritis international Society classification criteria for axial spondyloarthritis (part II): validation and final selection. Ann Rheum Dis. 2009 Jun;68(6):777–83. pmid:19297344
  36. 36. Rudwaleit M1, van der Heijde D, Landewé R, Akkoc N, Brandt J, Chou CT et al. The Assessment of SpondyloArthritis International Society classification criteria for peripheral spondyloarthritis and for spondyloarthritis in general. Ann Rheum Dis. 2011 Jan;70(1):25–31. pmid:21109520
  37. 37. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19:349–57. pmid:17872937
  38. 38. Curtis JR, Xie F, Yun H, Bernatsky S, Winthrop K. Real-world comparative risks of herpes virus infections in tofacitinib and biologic-treated patients with rheumatoid arthritis. Ann Rheum Dis 2016;75:1843–7. pmid:27113415
  39. 39. Taylor PC, Weinblatt ME, Burmester GR, Rooney TP, Witt S, Walls CD et al. Cardiovascular Safety During Treatment With Baricitinib in Rheumatoid Arthritis. Arthritis Rheumatol. 2019;71:1042–1055. pmid:30663869
  40. 40. Gossec L, Fautrel B, Flipon E, Lecoq d’André F, Marguerie L, Nataf H, et al. Safety of biologics: elaboration and validation of a questionnaire assessing patients’ self-care safety skills: the BioSecure questionnaire. An initiative of the French Rheumatology Society Therapeutic Education section. Joint Bone Spine. 2013;80:471–6. pmid:23972274
  41. 41. Beauvais C, Gaud-Listrat , Sellam J, Fayet F, Beranger M, Deparis N, et al Patients’ safety skills assessment with biologics and JAK inhibitors: Update of the BioSecure questionnaire. Joint Bone Spine. 2021 May 14;88(5):105215. pmid:33992790
  42. 42. Haute Autorité de Santé (French High Authority for Health), https://www.has-sante.fr/ (07.15.2021).
  43. 43. Agence nationale du medicament (National drug agency), https://ansm.sante.fr/ (07.15.2021).
  44. 44. Site Web de la Caisse primaire d’assurance maladie (National health service website) https://www.ameli.fr/ (07.15.2021)
  45. 45. Centre de référence sur les agents tératogènes (reference center for teratogens https://www.lecrat.fr/ (07.15.2021) and guidelines of the French Society of Rheumatology
  46. 46. Club Rhumatismes et Inflammations (CRI), www.cri-net.com (07.15.2021).
  47. 47. Beauvais C, Rodère M, Pereira B, Legoupil N, Piperno M, Pallot Prades B et al. Essential knowledge for patients with rheumatoid arthritis or spondyloarthritis: Results of a multicentric survey in France among health professionals and patients. Joint Bone Spine. 2019; 86:747–752. pmid:31228620
  48. 48. Hiboot Website. www.hiboot.fr (07.15.2021)
  49. 49. Najm A, Lempp H, Gossec L, Berenbaum F, Nikiphorou E et al. Needs, Experiences, and Views of People With Rheumatic and Musculoskeletal Diseases on Self-Management Mobile Health Apps: Mixed Methods Study. JMIR Mhealth Uhealth. 2020;20:e14351.
  50. 50. Knitza J, Simon D, Lambrecht A, Raab C, Tascilar K, Hagen M et al. Mobile Health Usage, Preferences, Barriers, and eHealth Literacy in Rheumatology: Patient Survey Study. (JMIR Mhealth Uhealth 2020;8(8):e19661) pmid:32678796
  51. 51. Barlow JH, Williams B, Wright CC. Patient education for people with arthritis in rural communities: the UK experience. Patient Educ Couns 2001;44:205–14. pmid:11553421
  52. 52. Nikiphorou E, Santos EJF, Marques A, Böhm P, Bijlsma JWJ, Daien CI, et al. 2021 EULAR recommendations for the implementation of self-management strategies in patients with inflammatory arthritis Ann Rheum Dis Epub ahead of print: pmid:33962964
  53. 53. Grainger R, Townsley HR, Ferguson CA, Riley FE, Langlotz T, Taylor WJ. Patient and clinician views on an app for rheumatoid arthritis disease monitoring: function, implementation and implications. Int J Rheum Dis. 2020. https://doi.org/10.1111/1756-185X.13850.
  54. 54. Gossec L, Molto A, Romand X, Puyraimond-Zemmour D, Lavielle M, Beauvais C et al. Recommendations for the assessment and optimization of adherence to disease-modifying drugs in chronic inflammatory rheumatic diseases: A process based on literature reviews and expert consensus. Joint Bone Spine. 2019;86:13–19. pmid:30243782
  55. 55. Beauvais C, Pau D, Hautin-Monteil V, Ducrot MC, Veerabudun K, Flipo RM. One-third of patients are low-adherent to methotrexate for rheumatoid arthritis at the initiation of a first biologic. A cross-sectional study investigating adherence rate and factors. Joint Bone Spine. 2020;87:668–669. pmid:32445934
  56. 56. Mary A, Boursier A, Desailly Henry I, Grados F, Séjourné A, Salomon S et al. Mobile Phone Text Messages and Effect on Treatment Adherence in Patients Taking Methotrexate for Rheumatoid Arthritis: A Randomized Pilot Study. Arthritis Care Res (Hoboken). 2019;71:1344–1352. pmid:30192070
  57. 57. Svendsen MT, Andersen F, Andersen KH, Pottegård A, Johannessen H, Möller S et al. Can an app supporting psoriasis patients improve adherence to topical treatment? A single-blind randomized controlled trial. BMC Dermatol 2018;18:2. pmid:29415699
  58. 58. Guillemin F, Saraux A, Guggenbuhl P, Roux C, Fardellone P, Le Bihan E et al. Prevalence of rheumatoid arthritis in France: 2001. Ann Rheum Dis. 2005; 64: 1427–1430. pmid:15800010
  59. 59. Saraux A, Guillemin F, Guggenbuhl P, Roux C, Fardellone P, Le Bihan E et al. Prevalence of spondyloarthropathies in France: 2001. Ann Rheum Dis. 2005;64:1431–5. pmid:15817661
  60. 60. Magnol M, Berard E, Rempenault C, Castagne B, Pugibet M, Lukas C et al. Use of ehealth by patients with rheumatoid arthritis: an observational, cross sectional, multicenter study. M. Magnol M, E. Berard E, C. Rempenault C, Castagne B Pugibet M Lukas C et al. J Med Internet Res. 2021; Jan: e19998.
  61. 61. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015;3:e27 pmid:25760773
  62. 62. Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and Validation of the User Version of the Mobile Application Rating Scale (uMARS). JMIR Mhealth Uhealth. 2016 10;4(2):e72. pmid:27287964
  63. 63. Salazar A, de Sola H, Failde I, Moral-Munoz JA. Measuring the quality of mobile apps for the management of pain: systematic search and evaluation using the mobile app rating scale. JMIR Mhealth Uhealth 2018;6(10):e10718. pmid:30361196