Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The Effectiveness of Teleglaucoma versus In-Patient Examination for Glaucoma Screening: A Systematic Review and Meta-Analysis

  • Sera-Melisa Thomas ,

    sthoma49@uwo.ca

    Affiliation Department of Epidemiology and Biostatistics, Schulich School of Medicine and Dentistry, Western University, London, Canada

  • Maya Jeyaraman,

    Affiliation Department of Epidemiology and Biostatistics, Schulich School of Medicine and Dentistry, Western University, London, Canada

  • William G. Hodge,

    Affiliations Department of Epidemiology and Biostatistics, Schulich School of Medicine and Dentistry, Western University, London, Canada, Department of Ophthalmology, Ivey Eye Institute, St. Joseph's Health Care London, London, Canada

  • Cindy Hutnik,

    Affiliation Department of Ophthalmology, Ivey Eye Institute, St. Joseph's Health Care London, London, Canada

  • John Costella,

    Affiliation Allyn and Betty Taylor Library, Western University, London, Canada

  • Monali S. Malvankar-Mehta

    Affiliations Department of Epidemiology and Biostatistics, Schulich School of Medicine and Dentistry, Western University, London, Canada, Department of Ophthalmology, Ivey Eye Institute, St. Joseph's Health Care London, London, Canada

The Effectiveness of Teleglaucoma versus In-Patient Examination for Glaucoma Screening: A Systematic Review and Meta-Analysis

  • Sera-Melisa Thomas, 
  • Maya Jeyaraman, 
  • William G. Hodge, 
  • Cindy Hutnik, 
  • John Costella, 
  • Monali S. Malvankar-Mehta
PLOS
x

Correction

5 Mar 2015: The PLOS ONE Staff (2015) Correction: The Effectiveness of Teleglaucoma versus In-Patient Examination for Glaucoma Screening: A Systematic Review and Meta-Analysis. PLOS ONE 10(3): e0118688. https://doi.org/10.1371/journal.pone.0118688 View correction

Abstract

Background

Glaucoma is the leading cause of irreversible visual impairment in the world affecting 60.5 million people worldwide in 2010, which is expected to increase to approximately 79.6 million by 2020. Therefore, glaucoma screening is important to detect, diagnose, and treat patients at the earlier stages to prevent disease progression and vision loss. Teleglaucoma uses stereoscopic digital imaging to take ocular images, which are transmitted electronically to an ocular specialist. The purpose is to synthesize literature to evaluate teleglaucoma, its diagnostic accuracy, healthcare system benefits, and cost-effectiveness.

Methods

A systematic search was conducted to help locate published and unpublished studies. Studies which evaluate teleglaucoma as a screening device for glaucoma were included. A meta-analysis was conducted to provide estimates of diagnostic accuracy, diagnostic odds ratio, and the relative percentage of glaucoma cases detected. The improvements to healthcare service quality and cost data were assessed.

Results

Of 11237 studies reviewed, 45 were included. Our results indicated that, teleglaucoma is more specific and less sensitive than in-person examination. The pooled estimates of sensitivity was 0.832 [95% CI 0.770, 0.881] and specificity was 0.790 [95% CI 0.668, 0.876]. The relative odds of a positive screen test in glaucoma cases are 18.7 times more likely than a negative screen test in a non-glaucoma cases. Additionally, the mean cost for every case of glaucoma detected was $1098.67 US and of teleglaucoma per patient screened was $922.77 US.

Conclusion

Teleglaucoma can accurately discriminate between screen test results with greater odds for positive cases. It detects more cases of glaucoma than in-person examination. Both patients and the healthcare systems benefit from early detection, reduction in wait and travel times, increased specialist referral rates, and cost savings. Teleglaucoma is an effective screening tool for glaucoma specifically for remote and under-services communities.

Introduction

Vision impairment represents a serious public health concern since it impacts social, mental, and physical health of an individual. Visual impairment limits independence and activities of daily life. Those with visual impairment require more social support systems, visual aids, and modifications to home life. They are at a higher risk for injuries, falls, psychological conditions, and are admitted to nursing homes earlier compared to those without a vision impairment [1].

Glaucoma is the leading cause of irreversible visual impairment in the world affecting 60.5 million people worldwide in 2010 [2]. In developed countries, half of glaucoma patients may not experience vision loss until the advanced stages of the disease and this is expected to be greater in undeveloped countries [3]. Since there is no cure for glaucoma, glaucoma can progress to blindness if left untreated. Further, glaucoma accounts for 12% of blind persons worldwide which is expected to increase to approximately 79.6 million in 2020 [4]. The largest impact is expected in China and India, which accounts for 40% of all cases together [4].

The burden of the glaucoma has affected both the health care and economic systems. In Canada, alone, vision loss costs the economy $15.8 billion per year in which 55% is allocated to direct health care costs [5]. Sixty-five per cent of adults with partial or full vision loss are unemployed, which translates to $4.06 billion annually of lost earnings [5]. The direct costs of glaucoma is estimated in the United States to be $623 for mild, $1915 for moderate, and $2511 for severe forms of glaucoma and similarly in Europe the costs are €455 per person each year for mild glaucoma and €969 per person each year for severe glaucoma [4]. Varma et al. reported as glaucoma progresses to each stage, there is an €86 increase in treatments costs in European.

Glaucoma screening is important to detect, diagnose, and treat patients at the earlier stages. Screening and diagnostic tools are significant to prevent glaucoma from progressing to advanced stages and maintaining health vision. In addition, glaucoma prevention will minimize future healthcare costs. Screening improves efficiency of the health care system by increasing the number of patients accessing ophthalmic services and it reduces the number of false-positive referrals to ophthalmologists [6].

The standard of care for glaucoma screening is routine optometrist visits every 2–3 years and any suspect glaucoma patient will be referred to an ophthalmologist for additional diagnostic testing [5]. Those of older ages are at a greater risk of glaucoma and thus ophthalmologists recommend routine optometrist visits every 2 to 4 years for adults between 40 to 64 years and every 1 to 2 years when aged 65 and older [7]. Patients regularly seen by ophthalmologist for other ocular conditions may also be referred for glaucoma diagnostic testing if signs appear. In-patient care for glaucoma (passive “in-person screening”) is performed at specialized clinics and includes detailed history, slit lamp examination, visual field testing, and fundus photography performed by the optical technician followed by consultation with the ophthalmologist [8].

Teleglaucoma is a relatively new screening and diagnostic tool for targeting remote or under-serviced communities. It uses stereoscopic digital imaging to take ocular images which are transmitted electronically to an ocular specialist. The ocular specialist will then assess the images, identify risk factors and diagnose for glaucoma. If necessary the ocular specialist will refer identified glaucoma cases for medical consultations or to ophthalmologists for follow-up treatment. Unlike other teleophthalmology tools, teleglaucoma requires more sophisticated diagnostic tests. The main tests are optic nerve photographs, Optical Coherence Tomography (OCT), Intraocular Pressure (IOP) measurements, central corneal thickness (CCT) measurements, and visual field tests [9]. The combination of examinations and equipment required can vary based on organizational resources, target goals and populations. However, the more diagnostic tools used during screening for glaucoma the greater the accuracy and effectiveness of the screening process. The equipment required for teleglaucoma are the ophthalmic examination equipment, cameras, and computer imaging software. The A full list of the standard equipment and components of teleglaucoma can be found in Table 1 [9].

The advantages reported in the literature include convenience, decreased travel time to medical clinics, increased access to specialized care for glaucoma, and decreased patient costs [10], [11] The benefits are mainly seen in remote or under-serviced communities such as Aboriginal communities and rural or remote areas where there is limited ocular specialists. Arora et al. reported improved access time (time from patient being referred to the date visit is booked) with teleglaucoma versus standard in-person examinations: 45 days for teleglaucoma versus in-person exam which had 88 days [12]. Teleglaucoma had reduced cycle time (time from registration until patient leaves clinic) of 78 minutes versus in-person exam of 115 minutes [12]. The pioneer teleglaucoma study conducted in Finland reported reduced absence from work by 50% with teleglaucoma versus in-person examination, and in addition reduced traveling (97%), costs (92%), and time (92%) [11].

The literature suggests teleglaucoma has comparable diagnostic accuracy. Teleglaucoma technology demonstrated moderate agreement in its ability to diagnose glaucoma (Kappa statistic 0.55% (0.48, 0.62)) [13]. When disc damage had Vertical Cup Disc Ratio (VCDR) greater than 0.7 the Frequency Doubling Technology (FDT) had a substantial agreement with ability to diagnose glaucoma (kappa statistic 0.84) [13]. In addition, a study conducted in rural India compared the ability of teleglaucoma to detect glaucoma compared to standard in-clinic examination and found that there was good agreement in detecting glaucoma [14]. For glaucoma the kappa scores were 0.61 with standard screening versus 0.59 for teleglaucoma [14]. In comparison to the in-person slit lamp examination, the positive predictive value was 77.5% for positive teleglaucoma diagnosis and had a negative predictive value of 82.2% for negative teleglaucoma diagnosis [13]. However, a cohort study conducted by the University of Alberta found 24% of teleglaucoma photographs were deemed unreadable from media opacities, patient cooperation, and unsatisfactory photographic techniques [13].

In this study, a systematic review and meta-analysis was conducted on teleglaucoma screening for patients with glaucoma to evaluate the following: the effectiveness of teleglaucoma as a screening device, its diagnostic accuracy, its diagnostic odds ratio, and its cost-effectiveness in comparison to in-person examination. Section 2 will explain the methods, section 3 provides the detailed analysis, and section 4 concludes with a discussion and implications for future research.

Methods

Search Strategy

A search methodology was used to assist in locating both published and unpublished studies. Research databases and conference meeting abstracts were searched for articles published from 1999 to current, and included MEDLINE (OVID and PubMed), Cochrane Library (Wiley), BIOSIS (Thomson-Reuters), CINAHL (EBSCO), Web of Science (Thomson-Reuters), and EMBASE (OVID). The grey literature was explored by searching Dissertations and Theses (ProQuest), the Canadian Health Research Collection (Ebrary), as well as the annual meeting abstracts of the European Society of Ophthalmology, Canadian Society of Ophthalmology (CSO), Association for Research in Vision and Ophthalmology (ARVO), and American Academy of Ophthalmology (AAO). The Conference Proceedings Citation Index was also included as part of the Web of Science search. Hand searches of ARVO's Investigative Ophthalmology & Visual Science journal and Canadian Journal of Ophthalmology associated with CSO were performed. The search strategies employed database specific subject headings and keywords for glaucoma, tele-screening, detection, and their synonyms. Each strategy was structured to accommodate for database and platform specific terminology, and syntax. Supplementary File S1 contains the complete search strategies used for the various databases (Table S1). Alerts were set up for each database to receive publication notifications for new related articles.

Inclusion and exclusion criteria

Articles included were from any country, all in English, published from 1999 to current, and were research articles. The articles included study population that are adults in the general population or populations at risk of glaucoma. The study population included those with or without glaucoma. Articles on teleglaucoma intervention for glaucoma screening were included, both in-comparison to in-person screening and analyzing teleglaucoma on its own. Outcome measures of teleglaucoma articles selected contained efficiency measures, specificity, sensitivity, and its ability to detect glaucoma, as well as patient benefits and cost data. Economic evaluations such as cost-effectiveness analysis and studies with costing data were also included.

The exclusion criteria was articles published prior to 1999 since teleglaucoma is fairly new and to be consistent with the teleglaucoma screening procedure, year 1999 was selected as a cut-off year. Additionally, non-research articles such as methodology papers, editorials, review articles, commentaries, and letters were excluded. Articles on diagnosis or prognosis, genetic screening, and teleophthalmology for ocular conditions other than glaucoma were eliminated.

A total of 11237 articles were retrieved by searching various databases and an additional 526 were retrieved from hand searching and grey literature search which were then imported into EPPI 4.0 reference manager. Based on the inclusion and exclusion criteria, two reviewers independently reviewed all articles. After removing duplicate articles, 8157 articles were included for screening. Articles were screened by title, abstract, and full text in level 1, 2, and 3 screening respectively. After each level of screening, kappa statistics was calculated to measure reviewer's agreement. Additionally, if consensus was not reached by the two reviewers' then a third reviewer intervened to solve disagreements on article eligibility. The agreement between the two reviewers was excellent (kappa  = 0.86). The PRISMA diagram demonstrating the selection process is displayed in Figure 1 (Table S3).

Quality Assessment Strategy

Articles were assessed using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) guidelines for publication bias, risk of bias, imprecision, inconsistency, and indirectness [15][20]. Articles were graded as either low, moderate, or high quality of evidence. The results indicated that 17 articles were high quality, 13 were moderate quality, and 15 articles were graded as low quality of evidence. Despite the quality of evidence, all articles were included in the analysis.

Data Extraction Strategy

Qualitative and quantitative data necessary for analysis was obtained from each article. Information on study location, design, effect measures (sensitivity and specificity), percentage of glaucoma diagnosed, service times, image quality, visual acuities, ophthalmic characteristics, and costs were collected. One reviewer extracted data using an excel template. Authors were emailed to obtain missing relevant information. All databases were updated with new information from respective authors. Additional current costing data was provided by ophthalmic equipment vendors INNOVA, Topcon, and Ocular Health Network. Costs were converted to 2014 US dollars [21]. This research study has no financial relationships, investments, or sponsorship related to the cited commercial vendors.

Data Analysis

Data was synthesized and analyzed using STATA 13. When studies reported estimates as range or p-value or multiple estimates, mean and standard deviation (SD) were derived. Hierarchical logistic regression was used to determine the pooled estimates of sensitivity and specificity of teleglaucoma and in-person examination. A graphical representation of the summary estimates was presented in a Hierarchical Summary Receiver Operating Characteristic (HSROC) curve with 95% confidence intervals and 95% prediction regions.

The positive/negative likelihood ratios (LR+/LR−) were calculated using bivariate models to generate estimates of the likelihood of a positive/negative test in a glaucoma/non-glaucoma patient. From this result the diagnostic odds ratio (DOR) was calculated to determine the relative diagnostic effectiveness of teleglaucoma. DOR is the ratio of the odds of a positive screen test in a glaucoma case relative to the odds of a negative screen test in a non-glaucoma case [22].

Due to the variability of study effectiveness measures, not one article had a complete set of data. Missing data was treated as statistically missing values and not included in the analysis. Only articles with complete data were included in each analysis. Publication bias was assessed using funnel plots.

Results

A total of 45 studies were included in this meta-analysis. Table 2 and Table 3 display the baseline characteristics of each study. Studies were conducted in fourteen different countries with representation in each continent. All articles were published between 1999 and 2014. The cumulated individuals of all studies were 101,512 participants. All studies were observational studies, as there were no randomized controlled trials conducted. Three studies contained economic evaluations or cost-effectiveness analysis. Of the 45 studies, 16 compared teleglaucoma to in-person examination. The other 29 studies analyzed teleglaucoma without comparison or was an evaluation of different teleglaucoma equipment. There was minimal variation in study populations; they included either glaucoma patients or patients who were at risk of glaucoma (based on diabetes status, family history of glaucoma, age, or ethnicity). Table 4 displays additional study details on demographics and study methods (glaucoma definition, pupil dilation, and number of field tests examined). Although there was some variation, less than 10% of studies reported these details. The main outcome measures were specificity and sensitivity (Table 5). Other included outcome measures (percentage of glaucoma diagnosed, referral rate, and proportion of images with poor quality) are displayed in table 5.

thumbnail
Table 2. Baseline characteristics of included studies – demographics.

https://doi.org/10.1371/journal.pone.0113779.t002

thumbnail
Table 3. Baseline characteristics of included studies – intervention.

https://doi.org/10.1371/journal.pone.0113779.t003

thumbnail
Table 4. Additional Details on Baseline Characteristics of Included Studies.

https://doi.org/10.1371/journal.pone.0113779.t004

Costing data was given by nine studies and the quality of analysis of costing is displayed in table 6. Teleglaucoma costs vary by the capacity of the service and the type and amount of equipment. The current vendor estimate shows that the total costs for standard glaucoma equipment range from 89,703.53 to 123,164.55 US dollars (Table 6) [23], [24]. Additionally, to transfer images and patient test results securely to ophthalmologists electronically a service exists costing $62.13 US/month [21], [25]. This service allows teleglaucoma technicians and ophthalmologists to login electronically to attach, send, view and assess retinal images and patient test results.

Costing data from the literature shows the cost per detected case of glaucoma ranged from $13.03–2020.96 US after conversion to US dollars and adjusted for inflation to 2014 costs (Table 7) [26]. The mean cost is $1098.67 US for every case of glaucoma detected (n = 3) (Table 7). The mean cost of teleglaucoma per patient screened was $922.77 US (n = 2) (Table 7).

Another necessary costing aspect is the ophthalmologist fee for glaucoma consultation. The ophthalmologist may be compensated for each teleglaucoma referral or time spent on teleophthalmology consultations. Compensation varies by states and/or provinces, government legislation, and available private grants. In the United States, Medicare and Medicaid provide several reimbursement programs for physicians delivering telemedicine consultations [27], [28]. In Ontario, Canada, the compensation for the fee-for service model, is $16.00 CAN per ophthalmic referral [29]. The physician liable for teleglaucoma consultations must be a licensed ophthalmologist in both the area of the service and the patient. Physicians must hold liability coverage appropriate to state/provincial laws. In Canada, the Canadian Medical Protective Association provides ophthalmologists with liability coverage for teleophthalmology [30].

Ten studies had complete data necessary to conduct the analysis for teleglaucoma diagnostic accuracy. The summary estimate for sensitivity was 0.833 [95% CI 0.77, 0.88] and specificity was 0.79 [95% CI 0.668, 0.875] for glaucoma screening using optic nerve examinations (Figure 2). The summary estimates indicate that teleglaucoma correctly detects 83.3% of glaucoma cases and correctly classifies 79% of those without glaucoma as glaucoma-negative. Figure 3 displays each study estimate and the summary estimate with its associated confidence intervals and the generated HSROC curve. The distribution of the studies in the plot demonstrates the variability of both specificity and sensitivity amongst studies. Six studies fall outside of the 95% confidence interval of the summary estimate. The 95% prediction region is the estimate of future observations. The results demonstrate a fairly wide prediction region for both true predictions of specificity and sensitivity, with greater variability expected for specificity.

thumbnail
Figure 3. Hierarchical Summary Receiver Operating Characteristic (HSROC) plot.

https://doi.org/10.1371/journal.pone.0113779.g003

The study populations used to assess diagnostic accuracy were those at-risk of glaucoma (based on diabetes status, family history, age, ethnicity, etc.), optometrist and ophthalmic clinic patients, and patients who were glaucoma suspects (Table 1). One study reported its study population as glaucoma patients only (Table 1) and contrary, this study had one of the lower reported scores for diagnostic accuracy: specificity was 71.5% and sensitivity was 67% (Table 5) [31].

The diagnostic tools of the included studies varied slightly (Table 8). Eight out of the ten studies analyzed for sensitivity and specificity used at minimum optic nerve examinations as part of the screening process (Table 8). The other two studies reported using IOP or visual field defects as the methods to detect glaucoma suspects (Table 8). For these studies which did not include fundus photographs, the sensitivity and specificity were 81.5% and 95.5% respectively for glaucoma screening using only visual field and 38.1% and 98.8% respectively for glaucoma screening using IOP and Orbscan Topography (Table 5) [32], [33].

Three studies reported sensitivity and specificity of in-person examination. The weighted mean of sensitivity was 74.9±27.6% (n = 3) and specificity was 88.8±10.3% (n = 3) for in-person examination. The summary estimates indicate that in-person examination correctly detects 74.9% of glaucoma cases and correctly classifies 88.8% of those without glaucoma as glaucoma-negative.

The positive likelihood ratio was 3.97 [95% CI: 2.3–6.7] while the negative likelihood ratio was 0.21 [95% CI: 0.14–0.32] (Figure 2). This demonstrates that the likelihood of a positive screen test in a glaucoma case is greater than the likelihood of a negative screen test in a non-glaucoma case. In addition, the positive likelihood ratio is greater than one and thus the positive screen test is associated with glaucoma. Since the negative likelihood ratio is less than one, the negative screen test is associated with the absence of disease [22]. The effectiveness of the diagnostic accuracy of teleglaucoma was given by the DOR, which was 18.7 [95% CI: 7.9–44.4] (Figure 2). The relative odds of a positive screen test in glaucoma cases are 18.7 times more likely than a negative screen test in a non-glaucoma case. Since the DOR was greater than one the test is discriminating between true positives and true negatives correctly [22].

There was insufficient data to conduct hierarchical logistic regression on the percentage of glaucoma diagnosed. Three of the 45 studies reported percentage of glaucoma diagnosed in both teleglaucoma and in-person examination necessary for analysis. The mean percentage of glaucoma diagnosed was 13.4% for teleglaucoma and 7.8% for in-person examination which suggests that teleglaucoma is capable of detecting more cases of glaucoma.

Other effectiveness measures of teleglaucoma were analyzed such as variables of healthcare service quality. The mean percentage of patients referred to specialist for consultation was 12.5±7.8% (n = 6). The mean percentage of images that were of poor quality was 10.4±6.7% (n = 7). It took a mean time of 75.6±87.7 seconds (n = 4) to process the teleglaucoma images. Timing associated with teleglaucoma service is another measure of quality. The mean time for screening was 8.8±5.1 minutes (n = 3). The time reported for ophthalmologist to make diagnosis was 34 minutes (n = 1). The mean reporting time was 7.6±2.6 minutes (n = 6). Teleglaucoma gave a reduction for patient travel time of 61.23 hours (n = 1). Teleglaucoma had a mean access time (time from patient being referred to the date visit is booked) of 59.7±9.9 minutes (n = 4) in comparison to 73.7±29.8 minutes (n = 4) for in-person examination. The mean cycle time (time from registration until patient leaves clinic) for teleglaucoma was 81.7±6 minutes (n = 2), which was less than that of in-person examination, 116±2.5 minutes (n = 2). The mean proportion of patient satisfaction with teleglaucoma was 47.3±8.8% (n = 2) while only 42% (n = 1) were satisfied with in-person examination.

Discussion

Telemedicine has demonstrated good use for offering glaucoma services to people of remote areas. Teleglaucoma is beneficial to remote areas as the physician is not required to see patients in person, which reduces wait times and shortens the length of ophthalmic consultations. Teleglaucoma avoids long distance travel and time wasted on commute. The results of the pooled estimates for diagnostic accuracy have shown teleglaucoma to be more sensitive and less specific than in-person examinations. Teleglaucoma is advantageous at detecting true positive cases of glaucoma, but has a higher rate of false positives in comparison to in-person examination. With very high DOR estimates, it is suggested that teleglaucoma can accurately discriminate screen tests. Teleglaucoma has demonstrated capability to detect glaucoma cases that may not have been detected during in-person examination. Glaucoma progresses without patient awareness and it is usually detected at the advanced stages. Thus teleglaucoma serves as a tool for early detection of glaucoma. If caught earlier and with treatment, glaucoma can be effectively managed and can result in the preservation of vision.

Telemedicine for glaucoma can have several combinations of examinations and measurements used for glaucoma screening. Examination of fundus photographs are commonly used for teleglaucoma screening. Four of the ten studies analyzed used only fundus examinations while another four studies included IOP, CCT, visual field loss, and visual acuity, in addition to fundus photograph examinations (Table 8). Two studies did not use fundus photograph examination but rather visual acuity, IOP, CCT, and ACT (Table 8). However, this is based on studies who explicitly stated the terms for ophthalmic examination. Some studies reported “comprehensive eye examinations” were performed, but did not explicitly state which examinations were performed, thus assumptions cannot be made. The use of different tests for glaucoma screening can potentially bias the results as the more diagnostic tools used during screening results in a greater probability of correct diagnosis naturally. However, the results did not show any significant differences in accuracy with studies which reported using multiple diagnostic tools. Interestingly, the specificity and sensitivity values reported ranged independent of the number and the type of examination used for teleglaucoma (Table 4 and Table 8).

The combinations of examinations are dependent on financial and resource limitations of the hosting organization and can vary from small programs to very large programs. It is dependent on the target goals and target populations of the organization. However, the standard examinations recommended for glaucoma screening are those that can evaluate visual field defects, IOP, and the biological structure and function of the optic nerve. These include HRT, OCT, optic disc photography, RNFL photography, as well as FDT, tonometry, and perimetry [34]. There were limitations within the study. Insufficient data reported was a major limitation of the meta-analysis, although authors were contacted for additional information. Nevertheless, the key goal was to systematically review the literature on tele-glaucoma and in-person screening and perform the meta-analysis. With small samples sizes there was not enough power to show statistical or clinical significance. Different comparators were reported by studies and to ensure internal validity, only studies with exact comparators were analyzed together. This was one of the reasons for reduced sample sizes for the analysis. However, our analysis does provide information on diagnostic accuracy of teleglaucoma, its capability to detect glaucoma, and to detect negative and positive cases correctly. It demonstrates teleglaucoma has the potential as a screening device to detect a greater amount of cases than in-person examination. Since teleglaucoma is an active screening, it suggests glaucoma cases are detected at earlier stages. However the significance of this difference is limited by the number of comparative studies. The majority of the studies were non-comparative which, in addition, limits the significance of the relative effectiveness to in-person examination.

Teleglaucoma has been evaluated in many different ways: diagnostic accuracy, cost reduction, technological capabilities (image quality, image transmission speed, etc.), reduction of patient and health care provider time, and convenience. Thus many studies focus on only part of the effectiveness. As a result, there is insufficient data when summarizing all of the studies together. This has proven the need for more research literature on the diagnostic accuracy of teleglaucoma and its ability to detect glaucoma in comparison to in-person examination. There is a need for research on the follow-up of detected cases and long-term effects of teleglaucoma. In addition, better quality of evidence through randomized controlled trials is recommended. There are implications for cost-effectiveness analyses. Although, costing data suggests cost savings for patients' time and travel with teleglaucoma, a thorough costing of current health care expenditure is required to determine its overall cost-effectiveness from the scope of the healthcare system.

Teleglaucoma is beneficial to offering services in underserviced regions and rural areas. It considerably reduces patient access times and cycle times. The time required for service is shorter than in-person examination and physician commitments are reduced. As a result teleglaucoma saves costs to patients and costs to the health care system as a whole.

Supporting Information

Table S1.

Systematic review search strategy.

https://doi.org/10.1371/journal.pone.0113779.s001

(DOCX)

Author Contributions

Conceived and designed the experiments: SMT WGH MMM JC CH. Performed the experiments: SMT MJ WGH MMM JC CH. Analyzed the data: SMT MMM WGH. Wrote the paper: SMT MMM WGH JC CH.

References

  1. 1. The National Coalition for Vision Health (2009) Environmental Scan of Vision Health and Vision Loss in the Provinces and Territories of Canada.
  2. 2. Quigley HA, Broman AT (2006) The number of people with glaucoma worldwide in 2010 and 2020. Br J Ophthalmol 90(3):262–267.
  3. 3. Mohammadi SF, Saeedi-Anari G, Alinia C, Ashrafi E, Daneshvar R, et al. (2013) Is Screening for Glaucoma Necessary? A Policy Guide and Analysis. J Ophthalmic Vis Res 9(1):3–6.
  4. 4. Varma R, Lee P, Goldberg I, Kotak S (2011) An Assessment of the Health and Economic Burdens of Glaucoma. Am J of Ophthalmol 152(4):515–522.
  5. 5. Canadian National Institute for the Blind (CNIB) and the Canadian Ophthalmology Society (2009) Costs of vision loss in Canada. Access Economics Pty Limited Available: http://www.cnib.ca/eng/cnib%20document%20library/research/covl_full_report.pdf. Accessed 2014 June 20.
  6. 6. Shahid K, Kolomeyer A, Nayak N, Salameh N, Pelaez G, et al. (2012) Ocular telehealth screenings in an urban community. American Telemedicine Association. Telemed J E-Health 18(2):95–100.
  7. 7. Hatt S, Wormald R, Burr J (2006) Screening for prevention of optic nerve damage due to chronic open angle glaucoma. Cochrane Database of Systematic Reviews Issue 4. Art. No.: CD006129. DOI:0.1002/14651858.CD006129.pub2.
  8. 8. Glaucoma Research Society (GRS) of Canada (2014) Glaucoma. Available: http://www.glaucomaresearch.ca/. Accessed 2014 June 20.
  9. 9. Kassam F, Amin S, Sogbesan E, Damji K (2012) The use of teleglaucoma at the University of Alberta. J Telemed Telecare 8:367.
  10. 10. Kassam F, Yogesan K, Sogbesan E, Pasquale L, Damji K (2013) Teleglaucoma: Improving access and efficiency for glaucoma care. Middle East Afr J Ophthalmol 20:142–149.
  11. 11. Tuulonen A, Ohinmaa A, Alanko H, Hyytinen P, Juutinen A, et al. (1999) The application of teleophthalmology in examining patients with glaucoma: a pilot study. J Glaucoma 8:367–73.
  12. 12. Arora S, Rudnisky C, Damji K (2014) Improved Access and Cycle Time with an “In-house” patient-centered teleglaucoma program versus traditional in-person assessment. Telemed J E-Health 20(5):439–45.
  13. 13. Kiage D, Kherani I, Gichuhi S, Damji K, Nyenza M (2013) The Muranga Teleophthalmology Study: Comparison of Virtual (Teleglaucoma) with in-person clinical assessment to diagnose glaucoma. Middle East Afr J Ophthalmol 20(2):150–157.
  14. 14. Gupta S, Sinha SK, Dagar AB (2013) Evaluation of the effectiveness of diagnostic & management decision by teleophthalmology using indigenous equipment in comparison with in-clinic assessment of patients. Indian J Med Res 138:531–5.
  15. 15. Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, et al. (2011) GRADE guidelines: 4. Rating the quality of evidence–study limitations (risk of bias). J Clin Epidemiol 64:407–415.
  16. 16. Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, et al. (2011) GRADE guidelines: 5. Rating the quality of evidence-publication bias. J Clin Epidemiol 64:1277–1282.
  17. 17. Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, et al. (2011) GRADE guidelines 6. Rating the quality of evidence-imprecision. J Clin Epidemiol 64:1283–1293.
  18. 18. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, et al. (2011) GRADE guidelines: 7. Rating the quality of evidence-inconsistency. J Clin Epidemiol 64:1294–1302.
  19. 19. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, et al. (2011) GRADE guidelines: 8. Rating the quality of evidence-indirectness. J Clin Epidemiol 64:1303–1310.
  20. 20. Guyatt GH, Oxman AD, Sultan S, Glasziou P, Akl EA, et al. (2011) GRADE guidelines: 9. Rating up the quality of evidence. J Clin Epidemiol 64:1311–1316.
  21. 21. Bank of Canada. Daily Currency Converter. Available: http://www.bankofcanada.ca/rates/exchange/daily-converter/.
  22. 22. Trikalinos T, Balion C, Coleman C, Griffith L, Santaguida L, et al. (2012) Meta-analysis of test performance when there is a “gold standard.” AHRQ Publication No. 12-EHC080-EF. Chapter 8 of Methods Guide for Medical Test Reviews (AHRQ Publication No. 12-EHC017). Rockville, MD: Agency for Healthcare Research and Quality.
  23. 23. INNOVA Medical Ophthalmics. Vendor Quotation Oct. 8, 2014. Ontario, Canada.
  24. 24. Topcon Canada Inc. Vendor Quotation Oct. 23, 2014. Ontario, Canada.
  25. 25. Ocular Health Network. Vendor Quotation Oct. 14, 2014. Ontario, Canada.
  26. 26. Bank of America. Foreign Currency Exchange. Available: https://www.bankofamerica.com/foreign-exchange/currency-converter.go 2014 July 25. Accessed 2014 July 25.
  27. 27. Centers for Medicare & Medicaid Services (2014) Telehealth Services. American Medical Association ICN 901705. Available: http://www.cms.gov/Outreach-and-Education/Medicare-Learning-Network-MLN/MLNProducts/downloads/TelehealthSrvcsfctsht.pdf. Accessed 2014 Oct 19.
  28. 28. Centers for Medicare & Medicaid (2014) Medicare Benefit Policy Manual, Chapter 15: Covered Medical and Other Health Services. Department of Health of Human Services, Publication # 100-04. Available: http://www.cms.gov/Regulations-and-Guidance/Guidance/Manuals/Downloads/bp102c15.pdf. Accessed 2014 Oct 19.
  29. 29. Toronto Central Local Health Integration Networks (LHIN) (2014) Teleophthalmology Services. Available: http://www.torontodiabetesreferral.com/teleophthalmology-service. Accessed 2014 Oct 19.
  30. 30. Ng M, Nathoo N, Rudnisky C, Tennant M (2009) Improving Access to Eye Care: Teleophthalmology in Alberta, Canada. J Diabetes Sci Technol 3(2):289–296.
  31. 31. Eikelboom RH, Yogesan K, Constable IJ, Barry CJ (1999) A handheld CCD fundus camera: an alternative to retinal photographs for glaucoma screening and telemedicine? Invest Ophthalmol Vis Sci 40(4MA 3488B346).
  32. 32. Ianchulev T, Pham P, Makarov V, Francis B, Minckler D (2005) Peristat: a computer-based perimetry self-test for cost-effective population screening of glaucoma. Curr Eye Res 30(1):1–6.
  33. 33. Kumar S, Middlemiss C, Bulsara M, Guibilato A, Morgan W, et al. (2006) Telemedicine-friendly, portable tonometers: an evaluation for intraocular pressure screening. J Clin Exp Ophthalmol Sep–Oct 34(7):666–70.
  34. 34. Moyer VA. U S. Preventive Services Task Force (2013) Screening for Glaucoma: U.S. Preventive Services Task Force Recommendation Statement. Ann Intern Med 159:484–489.
  35. 35. Li HK, Tang RA, Oschner K, Koplos C, Grady J, et al. (1999) Telemedicine screening of glaucoma. American Telemedicine Association. Telemed J 5(3):283–90.
  36. 36. Yogesan K, Constable IJ, Barry CJ, Eikelboom RH, Morgan W, et al. (1999) Evaluation of a portable fundus camera for use in the teleophthalmologic diagnosis of glaucoma. J Glaucoma 8(5):297–301.
  37. 37. Michelson G, Striebel W, Prioda W, Schmidt V (2000) Telemedicine in the control of intra-ocular pressure. J Telemed Telecare 6 Suppl 1S126–8.
  38. 38. Yogesan K, Constable IJ, Morgan W, Soebadi DY (2000) International transmission of tele-ophthalmology images. J Telemed Telecare 6(1):41–4.
  39. 39. Yogesan K, Cuypers M, Barry CJ, Constable IJ, Jitskaia L (2000) Tele-ophthalmology screening for retinal and anterior segment diseases. J Telemed Telecare 6 Suppl 1S96–8.
  40. 40. Gonzalez F, Iglesias R, Suarez A, Gomez-Ulla F, Perez R (2001) Teleophthalmology link between a primary health care centre and a reference hospital. Med Inform Internet Med 26(4):251–63.
  41. 41. Sebastian MA, Ayala ME, Sobas EM, Lopez MI, Anton A (2001) Assessment of a telemedicine screening program for glaucoma in a Spanish population. Invest Ophthalmol Vis Sci 42(4SU SMA 2994).
  42. 42. Wegner A, Zahlmann G (2003) Internet Based Glaucoma Screening. ARVO Meeting Abstracts 44(5):3417.
  43. 43. Labiris G, Fanariotis M, Christoulakis C, Petounis A, Kitsos G, et al. (2003) Tele-ophthalmology and conventional ophthalmology using a mobile medical unit in remote Greece. J Telemed Telecare 9(5):296–9.
  44. 44. Fansi A, Harasymowycz P, Descovich D, Belair ML (2003) Using HRT for telemedicine in glaucoma screening: The effect of different image file format on diagnosis of glaucoma. Invest Ophthalmol Vis Sci 44SU 2MA 3379.
  45. 45. Jin AJ, Martin D, Maberley D, Dawson KG, Seccombe DW, et al. (2004) Evaluation of a mobile diabetes care telemedicine clinic serving Aboriginal communities in Northern British Columbia, Canada. Int J Circumpolar Health 63 Suppl 2124–8.
  46. 46. Chen L, Tsai C, Liu T, Tung T, Chiu Y, et al. (2004) Feasibility of tele-ophthalmology for screening for eye disease in remote communities. J Telemed Telecare 10(6):337–341.
  47. 47. de Mul M, de Bont AA, Reus NJ, Lemij HG, Berg M (2004) Improving the quality of eye care with tele-ophthalmology: shared-care glaucoma screening. J Telemed Telecare 10(6):331–6.
  48. 48. Paul PG, Raman R, Rani PK, Deshmukh H, Sharma T (2006) Patient satisfaction levels during teleophthalmology consultation in rural south India. Telemed J E-Health 12(5):571–8.
  49. 49. Kumar S, Giubilato A, Morgan W, Jitskaia L, Barry C, et al. (2007) Glaucoma screening: analysis of conventional and telemedicine-friendly devices. J Clin Exp Ophthalmol 35(3):237–43.
  50. 50. Khouri AS, Szirth BC, Salti HI, Fechtner RD (2007) DICOM transmission of simultaneous stereoscopic images of the optic nerve in patients with glaucoma. J Telemed Telecare 13(7):337–340.
  51. 51. Pasquale LR, Asefzadeh B, Dunphy RW, Fisch BM, Conlin PR, et al. (2007) Detection of glaucoma-like optic discs in a diabetes teleretinal program. Optometry 78(12):657–63.
  52. 52. Khouri A, Szirth B, Shahid K, Fechtner R (2008) Software-assisted optic nerve assessment for glaucoma tele-screening. Telemed J E-Health 14(3):261–5.
  53. 53. de Bont A, Bal R (2008) Telemedicine in interdisciplinary work practices: On an IT system that met the criteria for success set out by its sponsors, yet failed to become part of every-day clinical routines. BMC Med Inform Decis Mak 8AR 47.
  54. 54. Sogbesan E, Rudnisky C, Tennant M, Damji K (2010) Time and cost-benefit analysis of a collaborative web-based stereoscopic teleglaucoma care model. Canadian Ophthalmology Society Annual Meeting.
  55. 55. Anton-Lopez A, Cots M, Duran-Tauleri F (2011) Cost-Effectiveness Analysis of a Telemedicine Program for the Detection of Glaucoma with Imaging Devices. ARVO Annual Meeting Abstract Search and Program Planner 2011:251.
  56. 56. Khurana M, Ramakrishnan R, Kader M (2011) Teleophthalmology aided Vision Centres in Rural South India: Role and Utilization of Services. ARVO Annual Meeting Abstract Search and Program Planner 2011:4228.
  57. 57. Staffieri SE, Ruddle JB, Kearns LS, Barbour JM, Edwards T, et al. (2011) Telemedicine model to prevent blindness from familial glaucoma. Clin Experiment Ophthalmol 39(8):760–5.
  58. 58. Swierk T, Jurgens C, Grossjohann R, Flessa S, Tost F (2011) Health economical aspects of telemedical glaucoma monitoring. Ophthalmologe 108(4):342–50.
  59. 59. Amin S, Damji K, Kassam F, Xu S, Edwards M, et al. (2012) In-house patient-centered teleglaucoma improves access and efficiency for glaucoma suspects and those with early stages of open-angle glaucoma (OAG). Canadian Ophthalmology Society Annual Meeting.
  60. 60. Damji K, Arora S, Rudnisky C (2013) Improving access and cycle time through a hospital based teleglaucoma program. Canadian Ophthalmological Society Annual Meeting.
  61. 61. Verma S, Arora S, Kassam F, Edwards M, Damji K (2013) Tele-glaucoma clinical outcomes and referral pathway. Canadian Ophthalmological Society Annual Meeting.
  62. 62. Ahmed R, Petrany S, Fry R, Krasnow M (2013) Screening diabetic and hypertensive patients for ocular pathology using telemedicine technology in rural West Virginia: a retrospective chart review. W V Med J 109(1):6–10.