Smartphones are increasingly playing a role in healthcare and previous studies assessing medical applications (apps) have raised concerns about lack of expert involvement and low content accuracy. However, there are no such studies in Urology. We reviewed Urology apps with the aim of assessing the level of participation of healthcare professionals (HCP) and scientific Urology associations in their development.
Material and Methods
A systematic search was performed on PubMed, Apple's App Store and Google's Play Store, for Urology apps, available in English. Apps were reviewed by three graders to determine the app’s platform, target customer, developer, app type, app category, price and the participation of a HCP or a scientific Urology association in the development.
The search yielded 372 apps, of which 150 were specific for Urology. A fifth of all apps had no HCP involvement (20.7%) and only a third had been developed with a scientific Urology association (34.7%). The lowest percentage of HCP (13.4%) and urological association (1.9%) involvement was in apps designed for the general population. Furthermore, there was no contribution from an Urology society in "Electronic Medical Record" nor in "Patient Information" apps. A limitation of the study is that only Android and iOS apps were reviewed.
Despite the increasing Mobile Health (mHealth) market, this is the first study that demonstrates the lack of expert participation in the design of Urology apps, particularly in apps designed for the general public. Until clear regulation is enforced, the urological community should help regulate app development. Maintaining a register of certified apps or issuing an official scientific seal of approval could improve overall app quality. We propose that urologists become stakeholders in mHealth, shaping future app design and promoting peer-review app validation.
Citation: Pereira-Azevedo N, Carrasquinho E, Cardoso de Oliveira E, Cavadas V, Osório L, Fraga A, et al. (2015) mHealth in Urology: A Review of Experts’ Involvement in App Development. PLoS ONE 10(5): e0125547. https://doi.org/10.1371/journal.pone.0125547
Academic Editor: Robert Hurst, Oklahoma University Health Sciences Center, UNITED STATES
Received: February 9, 2015; Accepted: March 14, 2015; Published: May 18, 2015
Copyright: © 2015 Pereira-Azevedo et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: The information underlying this study is publicly available from the iTunes App Store and on Google Play Store, and anyone can access it. A complete assessment of all urology apps, including its description and information about its creators, is available in file S1 Table, and can be accessed at (http://dx.doi.org/10.6084/m9.figshare.1363120).
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Smartphones and tablets are almost ubiquitous in our society and represent a popular method of accessing information. Smartphone applications (apps) are increasingly playing a role in healthcare . Mobile Health (mHealth) comprises "medical and public health practice supported by mobile devices" . The total mHealth market revenue is estimated to grow by about 61% to reach US$26 billion, at the end of 2017 . Moreover, previous studies report close to 100,000 medical apps available on the two leading software platforms, iOS (Apple) and Android (Google) . That number is expected to grow even further, as both Apple and Google have announced mHealth to be a top-priority [4, 5]. With the increasing number of available apps, there is a growing concern about their quality and safety, as there are no industry standards, no scientific guidelines and no independent medical app regulation [6–8].
Recently, papers assessing apps in various medical fields have been published, detailing the myriad of options available, which range from health and fitness apps for the general public, to medical education and teaching aids, as well as electronic health records and even augmented reality software [1, 9–12]. The clinical use of smartphone as diagnostic tools in Dermatology is one of the most common, but it is not without pitfalls: an app that claimed to quantify skin cancer risk mislabeled 80% of textbook melanomas [13, 14].
Apps designed for surgical specialties, such as Anesthesiology, Plastic Surgery and Neurosurgery, have also been scrutinized, with similar conclusions: app development offers great potential, but lacks standardized regulatory procedures [15–17]. Even though there have been papers demonstrating the use of apps in Urology, to our knowledge, there are no published studies reviewing healthcare professional involvement in apps specifically designed for Urology [18, 19]. This study had two aims. First, to review Urology apps, mainly in regards to mobile platform, target audience, developer, type of app, app category and price. Second, to identify which apps had documented HCP involvement and which were developed in collaboration with a scientific Urology association.
Three graders (an Urology resident and two Urology specialists) conducted a systematic review on PubMed, Apple App Store (iOS) and Google Play Store (Android), for Urology-themed apps, between September of 2014 and January of 2015. On PubMed, the searched terms were "Urology" and "mobile", "application", "app", "apps", "mHealth", "eHealth", "iOS", "iPhone", "iPad", "Android", "tablet" and "smartphone". Results were filtered for articles related with Urology apps that were available for download on the Apple App Store and on Google Play Store.
A similar query was also performed on both stores, for Urology-related apps. Android apps were searched at the Google Play online store. For iOS-based applications, the search was performed using iTunes v11.3.1 for Mac OS X (Apple Inc., Cupertino, CA, USA). All apps with "Urology" in their metadata (title, description, keywords and version history) were scrutinized. From the search results, graders included all apps that were available in English and designed specifically for Urology (e.g. "AUA Core Curriculum Mobile"). Exclusion criteria include those related with general medicine (e.g. "Clinical Tests & Procedures") or other fields (e.g. "Anatomy Flash Cards"), and apps that only had product advertisement, i.e. apps that only promoted pharmaceutical or medical equipment (e.g. "Actient Pharmaceuticals"). All three graders universally agreed on the criteria.
Based on all available information, the three reviewers decided on one of the following apps' type: Reference, Guidelines, and Quiz/Exam (e.g. Urology textbooks, Guidelines from an urological association); Conferences, Urological Societies/Associations, Journals and Institutions (e.g. "EAU Stockholm 2014", "AUA Member Search"); Calculators (e.g. "TNM Urology"); Electronic Medical Record/Diaries (e.g. "Bladder Pal"); and Patient Information (e.g. "Dealing with Prostate Cancer") (Table 1). They also determined the target audience (i.e. apps designed specifically for healthcare professionals or suitable for the general public). Moreover, they gathered data on the type of developer (i.e., apps developed by an individual or an organization) and the app's category. The app's category is chosen by the developer from a predetermined list of options, and represents the category where the app is available in the Store. Developers are required to select the category that best describes the app. Possible categories are Medical, Books & Reference, Education, Health & Fitness, Business, News & Magazines, Social, Utilities, Entertainment and Games. The app price (free or paid) and the actual price in dollars were also recorded.
Graders considered that there was involvement by HCP (e.g. urologists, other medical doctors, pharmacists, and specialist nurses) or a scientific Urology association in the apps’ design when it was mentioned in the app's description or website. Apps were not purchased or downloaded.
As an example, the app "AUA 2014 Annual Meeting" would be recorded in the database as: platform (Android and iOS), Target (Health professionals), Developer (Organization), Type (Conferences, Urological Societies/Associations, Journals and Institutions), Category (Medical), Price (Free), Actual price (0.0$), HCP involvement (Yes), scientific Urology association involvement (Yes).
First, a descriptive overview of available apps was performed. Second, all apps included in this review were assessed regardless of being available on both platforms or exclusively on Apple App Store or Google Play Store. When an app was available in both Stores, it was evaluated only once. However, some apps available in both platforms had differences between the two versions, namely in price and app category. When the price of the app was not the same on both Stores, the average price was calculated. When the app category was not the same on both platforms, the most recent version was considered.
To evaluate an association between targeted audience and healthcare professional or urological association involvement in the app development, the app price, and the developer, we used the chi-square test of association.
To analyze a relationship between the type of application and the involvement of a healthcare professional or an urological association in the development of the app, we calculated the chi-square test of association.
Analyses were performed using SPSS v20 (IBM Corp., Armonk, NY, USA).
Statistical significance was set at p < 0.05 for all analyses.
From the initial 372 apps (Android = 250, iOS = 122), we excluded all apps that were not available in English, not specific for Urology and that were only product advertisement (Fig 1). Table 1 lists all included apps and Table 2 displays the main characteristics of the surveyed apps. A complete assessment of all urology apps, including its description and information about its creators, is available as S1 Table, and can be accessed at http://dx.doi.org/10.6084/m9.figshare.1363120.
From the initial 372 apps (Android = 250, iOS = 122), we excluded apps not available in English, not specific for Urology or that were only product advertisement, for a total of 150 Urology apps (n = 44 exclusively for iOS, n = 56 exclusively for Android and n = 50 available for both platforms).
We found 44 apps exclusive to Apple App Store, 56 uniquely on Google Play Store and 50 available on both stores, for a total of 150 Urology apps.
Of the 150 individual apps, there were more apps targeted at healthcare professionals (72.7%) and published by organizations (88.0%). The most common type of app was "References, Guidelines, and Quiz/Exam" (36.7%), which included, for example, Urology textbooks and atlas.
Regarding app category, most were classified as "Medical" (68.7%), but many were available in the "Books & Reference" section (9.3%).
The vast majority of apps were free (71.3%). The average price of paid applications was 9.15 ±14.09 dollars, but there was a large range, from 0.99 dollars (five apps) to 71.94 dollars ("Urological Surgery", 71.94 dollars). The most expensive apps were "References, Guidelines, and Quiz/Exam". Taking into account the available free apps, the average app price dropped to 2.62 ± 8.55 dollars.
One in five apps had no documented HCP involvement in their design (20.7%). Moreover, only one-third of all reviewed apps had been developed in collaboration with a scientific Urology association (34.7%).
Furthermore, there was a statistically significant difference between target audience and HCP involvement in apps’ design (p<0.001): only 13.4% of all apps designed with input from a HCP were targeted for the general population. Additionally, there was a statistically significant difference between target audience and urological association involvement in the apps’ design (p<0.001). Similarly, the lowest percentage of urological association involvement in apps’ design was in apps designed for the general population (1.9%) (Table 3).
Moreover, there was statistically significant differences between apps’ type and HCP (p<0.001) and urological association (p<0.001) involvement in apps' design. The lack of HCP involvement in app development was highest in Patient Information apps (64.3%) and Electronic Medical Record/Diaries (40%). No Electronic Medical Record/Diaries nor Patient Information apps were developed with documented involvement by any scientific Urology association (Table 4).
There were no statistically significant differences between target audience and cost (free or paid, p = 0.13) nor developer type (individual or organization, p = 0.08).
To our knowledge, this is the first study that completely identifies healthcare professional involvement in apps specifically designed for Urology and hence can serve as a trigger for urological societies to further explore the opportunities and overcome potential pitfalls of mHealth in Urology.
The mHealth market is mostly self-regulated, but there is a need for an independent assessment of available apps, to prevent both HCP and the general public from apps of using questionable reliability. The current study shows that there is clearly a deficit of expert input in Urology apps, as more than one fifth of all available apps did not have any involvement of HCP and only a third had the involvement of a scientific Urology association. These results are slightly worse than those from other areas, but this seems to be an issue across multiple medical fields [20–22].
Google Play Store has more Urology apps than Apple App Store. One possible explanation for this difference is the contrasting app approval process on both platforms: Android apps are automatically approved. However, iOS apps need to respect Apple's Review Guidelines and are only published in the App Store after technical approval by Apple staff . For example, apps that share personal data without user consent are rejected .
The present study shows that the most common type of apps was "References, Guidelines, and Quiz/Exam" and most apps were available in the "Medical" category of the store, which is consistent with other reviews [13, 20].
Even though most apps were targeted at professionals, one fifth off all apps in our review are designed for patient information, which stresses the importance of safety even further, knowing that these users often lack scientific judgment.
Moreover, the involvement of commercial companies in this type of media has been questioned before, with worries about their funding and purpose . A particular concern is the potential bias in product promotion, which can ultimately create conflicts of interest between the developer, healthcare professionals and the end user.
Development of health apps should always involve healthcare experts. However, in our review, medical calculators had an unexpectedly low proportion of HCP participation in their design. This lack of involvement is also evident in patient-targeted apps, particularly in Electronic Medical Records and Patient Information apps.
Even when there was reference to a HCP or an urological society involvement in the app design, it was not possible to systematically assess their level of responsibility, either as an external advisor, major stakeholder or sole author. Moreover, we could not find any available tools or evidence on how to quantify this information in a reproducible method.
This issue has raised attention of some public entities, namely the National Health Service in England, which curates an online Health Apps Library, and also private companies (e.g. Happtique MobileHealth Source), which are developing certification processes for mobile apps, with the aim of regulating the mHealth market .
With the growing number of available apps, the challenge is finding safe and well-designed apps. HCP and scientific Urology association involvement can act as a quality check, which is of paramount importance, not only for healthcare-targeted apps, but even more so in apps designed for the general public.
In the same way that doctors involvement in social media (SoMe) has been the focus of attention and recommendation by urological societies, medical app development should become subject to the same regulation, and Urology must not be left out [25–29].
mHealth has the potential to be an important tool in the future of Urology. However, it is critical that scientific accuracy, patient privacy and user safety are assured. Even though some of the issues may not be within the competence of scientific Urology associations, they can still take an active role in this subject.
mHealth app development should be seen by urologists as an opportunity to provide greater care to our patients and better software and knowledge to our peers. Even though this paradigm might require learning some new tools and skills, engaging in app development can be a fulfilling opportunity for a alternative medical interaction.
The present study certifies the lack of healthcare professional involvement in Urology apps. Considering that apps included in this review represent less than 0.2% of available medical apps and that there are more breast cancer (total = 178, Android = 118, iOS = 59) apps than Urology apps in total, mHealth is an untapped potential in our field and further investigation is mandatory to clarify the role that apps may play in Urology .
This study has some limitations. We could not perform analyses on the mobile stores' rating and review data because, unlike Google Play Store, the Apple App Store does not show the rating of all apps. Another limitation is that only the Android and iOS apps were reviewed, even though there are other mobile app stores, namely Microsoft and Samsung. However, Apple's App Store and Google's Play Store are by far the most popular platforms. We only searched for apps that included "Urology" in their metadata. Therefore, some Urology apps, which did not include it in the description of the app, were not included. Even though all graders had to agree on the app's type classification, it remains subjective, which is a potential limitation. However, there is no standardized classification scheme available. Healthcare professional and urological society involvement was structured as a binary variable (i.e. yes/no), but was not quantified.
Apps represent a new opportunity to enhance care in Urology. Possible uses range from augmented reality apps that can be helpful in a clinical or surgical setting, to electronic diaries that aid in treatment monitoring and even health promoting apps. Even though there are, at the moment, 150 Urology apps, covering a wide range of subjects and directed at a diverse audience, there is room for improvement.
Until clear regulation is enforced, either by government health authorities or independent organizations, the urological community should adopt an active role as soon as possible, in a manner similar to what was done regarding SoMe [25–28]. Even though it is impossible to verify all available apps, maintaining a peer-reviewed register of certified Urology apps or issuing an official scientific seal of approval, could influence overall app design and, consequently, improve urological mHealth solutions.
S1 Table. List of all included Urology apps.
A complete assessment of all urology apps, including its description and information about its creators, is available as supporting information, and can be accessed at http://dx.doi.org/10.6084/m9.figshare.1363120
Conceived and designed the experiments: NPA MCB MR. Performed the experiments: NPA EC ECO LO VC AF. Analyzed the data: NPA MCB MR. Contributed reagents/materials/analysis tools: NPA EC ECO LO VC AF MCB MR. Wrote the paper: NPA EC ECO LO VC AF MCB MR.
- 1. Kwok R (2013) Mobile apps: A conference in your pocket. Nature 498: 20 Jun 395–397. pmid:23789123
- 2. World Health Organization (2011) mHealth: New horizons for health through mobile technologies (Global Observatory for eHealth series—Volume 3). Geneva, Switzerland: World Health Organization.
- 3. Research2Guidance (2013) The mobile health global market report 2013–2017: the commercialisation of mHealth apps (Vol. 3). Available: http://www.research2guidance.com/shop/index.php/downloadable/download/sample/sample_id/273/. Accessed September 2014.
- 4. Apple HealthKit. Available: https://developer.apple.com/healthkit/. Accessed September 2014.
- 5. Google Fit. Available: https://developers.google.com/fit/. Accessed September 2014.
- 6. Buijink AW, Visser BJ, Marshall L (2013) Medical apps for smartphones: lack of evidence undermines quality and safety. Evid Based Med 18: 90–92. pmid:22923708
- 7. McCartney M (2013) How do we know whether medical apps work? BMJ 346: f1811 (correction in BMJ, 346:f1974). pmid:23516158
- 8. Boxall NE (2014) Mobile apps: are we culturally out of signal? Emerg Med J. In print.
- 9. Pellegrini CA, Duncan JM, Moller AC, Buscemi J, Sularz A, DeMott A, et al. (2012) Study protocol: A smartphone- supported weight loss program: design of the ENGAGED randomized controlled trial. BMC Public Health 12: 1041. pmid:23194256
- 10. Gaglani SM, Topol EJ (2014) iMedEd: The Role of Mobile Health Technologies in Medical Education. Acad Med 89: 1207–1209. pmid:24892404
- 11. Lin Y-H, Chang L-R, Lee Y-H, Tseng H-W, Kuo TBJ, Chen SH. (2014) Development and Validation of the Smartphone Addiction Inventory (SPAI). PLoS ONE 9(6): e98312. pmid:24896252
- 12. Bahsoun AN, Malik MM, Ahmed K, El-Hage O, Jaye P, Dasgupta P. (2013) Tablet based simulation provides a new solution to accessing laparoscopic skills training. J Surg Educ 70: 161–163. pmid:23337687
- 13. Brewer AC, Endly DC, Henley J, Amir M, Sampson BP, Moreau JF, et al. (2013) Mobile Applications in dermatology. JAMA Dermatol 149: 1300–1304. pmid:24067948
- 14. Wolf JA, Moreau JF, Akilov O, Patton T, English JC 3rd, Ho J, et al (2013) Diagnostic Inaccuracy of Smartphone Applications for Melanoma Detection. JAMA Dermatol 149: 422–426. pmid:23325302
- 15. de la Vega R, Miró J (2014) mHealth: A Strategic Field without a Solid Scientific Soul. A Systematic Review of Pain-Related Apps. PLoS ONE 9(7): e101312. pmid:24999983
- 16. Kiranantawat K, Sitpahul N, Taeprasartsit P, Constantinides J, Kruavit A, Srimuninnimit V, et al (2014) The first Smartphone application for microsurgery monitoring: SilpaRamanitor. Plast Reconstr Surg 134: 130–139. pmid:25254859
- 17. Jensen Ang WJ, Hopkins ME, Partridge R, Hennessey I, Brennan PM, Fouyas I, et al (2014) Validating the use of smartphone-based accelerometers for performance assessment in a simulated neurosurgical task. Neurosurgery 10Suppl 1: 57–64; discussion: 64–65. pmid:23756748
- 18. Johnson EK, Estrada CR, Johnson KL, Nguyen HT, Rosoklija I, Nelson CP (2014) Evaluation of a Mobile Voiding Diary for Pediatric Patients with Voiding Dysfunction: A Prospective Comparative Study. J Urol. 192: 908–913. pmid:24704008
- 19. Hsi RS, Hotaling JM, Hartzier AL, Holt SK, Walsh TJ (2013) Validity and reliability of a smartphone application for the assessment of penile deformity in Peyronie's disease. J Sex Med 10: 1867–1873. pmid:23551808
- 20. Cantudo-Cuenca MR, Robustillo-Cortés MA, Cantudo-Cuenca MD, Morillo-Verdugo R (2014) A better regulation is required in viral hepatitis smartphone applications. Farm Hosp 38: 112–117. pmid:24669895
- 21. Carter T, O'Neill S, Johns N, Brady RR (2013) Contemporary vascular smartphone medical applications. Ann Vasc Surg 27: 804–809. pmid:23535521
- 22. Visvanathan A, Hamilton A, Brady RR (2012) Smartphone apps in microbiology—is better regulation required? Clin Microbiol Infect 18: E218–E220. pmid:22563840
- 23. Greene JA, Kesselheim AS (2010) Pharmaceutical marketing and the new social media. N Engl J Med 363: 2087–2089. pmid:21105789
- 24. Happtique Mobile Health Source. Available: http://www.happtique.com/ Accessed September 2014.
- 25. Matta R, Doiron C, Leveridge MJ (2014) The dramatic increase in social media in urology. J Urol. 192: 494–498. pmid:24576656
- 26. Rouprêt M, Morgan TM, Bostrom PJ, Cooperberg MR, Kutikov A, Linton KD, et al (2014) European Association of Urology (@Uroweb) recommendations on the appropriate use of social media. Eur Urol 66: 628–632. pmid:25043941
- 27. Murphy DG, Loeb S, Basto MY, Challacombe B, Trinh QD, Leveridge M, et al (2014) Engaging responsibly with social media: the BJUI guidelines. BJU Int 114: 9–11. pmid:25047091
- 28. American Urological Association. Social Media Best Practices. Available: https://www.auanet.org/press-media/social-media-bp.cfm. Accessed September 2014
- 29. Food and Drug Administration (2011) FDA Proposes Health 'App' Guidelines (Updated 2013). Available: http://www.fda.gov/ForConsumers/ConsumerUpdates/ucm263332.htm. Accessed September 2014.
- 30. Mobasheri M, Johnston M, King D, Leff D, Thiruchelvam P, Darzi A (2014) Smartphone breast applications—What's the evidence? Breast 23: 683–689. Available at Accessed September 2014. pmid:25153432