The purpose of the study was to evaluate the diagnostic accuracy of visual function tests in intermediate age-related macular degeneration (iAMD). A total of 62 subjects (38 patients with iAMD and 24 controls) were included and underwent several functional assessments: Best-corrected visual acuity (BCVA), low luminance visual acuity (LLVA), visual acuity (VA) measured with the Moorfields Vanishing Optotypes Acuity Charts (MAC), contrast sensitivity with the Pelli-Robson test, reading speed using the International Reading Speed texts (IReST) and mesopic and dark-adapted microperimetry (S-MAIA, CenterVue, Padova, Italy). Groups were compared using non-parametric Wilcoxon rank sum tests and ROC analyses. Linear regression was used to control for confounding. Results showed that all visual function test performances except the IReST were significantly reduced in iAMD patients compared to controls (p < 0.05). These effects did not alter after controlling for age and sex. Best discrimination between iAMD and controls yield the combination of LLVA and contrast sensitivity as well as MAC-VA and contrast sensitivity (ROC area under the curve 0.95 and 0.93, respectively). Our results suggest that LLVA, MAC-VA, contrast sensitivity and mesopic and dark-adapted microperimetry can capture visual impairment characteristic for iAMD. Best discrimination against iAMD is achieved with a combination of two tests.
Citation: Pondorfer SG, Heinemann M, Wintergerst MWM, Pfau M, Strömer AL, Holz FG, et al. (2020) Detecting vision loss in intermediate age-related macular degeneration: A comparison of visual function tests. PLoS ONE 15(4): e0231748. https://doi.org/10.1371/journal.pone.0231748
Editor: Olaf Strauß, Eye Hospital, Charité, GERMANY
Received: September 30, 2019; Accepted: March 31, 2020; Published: April 16, 2020
Copyright: © 2020 Pondorfer et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Ethical restrictions have been imposed on sharing the data underlying this study by the Institutional Review Board of the University of Bonn in keeping with patient protection considerations. Qualified, interested researchers may submit queries related to data sharing to the corresponding author (email: email@example.com) or to the Institutional Review Board of the University of Bonn (email: firstname.lastname@example.org).
Funding: R.P.F.: Else Kröhner Fresenius Stiftung/German Scholars Organization (GSO/EKFS 16) The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: NO authors have competing interests
Age-related macular degeneration (AMD) is the leading cause of visual impairment in the elderly in industrialized countries and an important public health problem [1,2]. Approximately 30–50 million people are affected by AMD worldwide . In Europe 24.1% of people aged over 60 are affected with early or intermediate stages and 2.2% suffer from late AMD . Due to current demographic trends, AMD is expected to increase considerably in the future [3,4].
Early stages of the disease are usually not associated with visual symptoms and patients typically perform well in conventional visual function tests under high luminance and high contrast. Nevertheless, patients may report difficulties and vision loss under low lighting, low contrast and changing light conditions [5–7]. These symptoms may occur even in the earliest stages of AMD when best-corrected visual acuity (BCVA) is unaffected [5,8]. However, the most widely used outcome measure in ophthalmic research is BCVA [9,10] measured with a high-contrast high-luminance chart with single black optotypes on a white background, such as the Early Treatment Diabetic Retinopathy Study (ETDRS) chart. These conventional charts appear to be largely insensitive to the specific functional impairment in early and intermediate AMD and to monitor disease progression [11–13]. Hence, more sensitive visual function tests are required [10,8].
The functional deficit under reduced luminance and/or contrast has been well documented in patients with early and intermediate AMD [14,15] using a number of different functional assessments such as low luminance visual acuity (LLVA) [8,14,16–18], visual acuity (VA) measurements with the Moorfields Vanishing Optotypes Acuity Chart (MAC), which employs high-pass filtered letters , contrast sensitivity tests [20–23,15,24,16,25], and fundus-controlled perimetry [12,26–28,9,9,29]. Combinations of any of these visual function tests might further increase sensitivity to detect changes in visual function in particular in early stages of AMD.
However, to date no study has employed all visual function tests previously identified as sensitive to the specific functional impairment in intermediate AMD (iAMD) and compared their ability to discriminate between iAMD and healthy controls. This, however, is required in order to inform selection of the best test or combination of tests in future observational or interventional studies assessing functional impairment in iAMD. Thus, we evaluated and compared an extensive battery of functional tests in patients with iAMD and in healthy controls.
We conducted a cross-sectional study at the Department of Ophthalmology, University of Bonn, Germany, from January 2017 until August 2018. The study was approved by the Institutional Review Board of the University Bonn (approval ID: 013/16). Written informed consent was obtained from all participants. The protocol followed the tenets of the Declaration of Helsinki.
38 patients with iAMD and 24 healthy subjects were recruited from the AMD outpatient clinic, the self-help organisation Pro Retina and family members of the patients. As common with exploratory studies, no formal sample size calculation was done, as to date no information is available on the test-retest reliability of all function tests or the responsiveness to change of the measures.
Inclusion criteria for the AMD group were drusen > 125 μm and/or any AMD pigmentary abnormalities according to the classification system introduced by Ferris et al. . For the control group inclusion criteria was BCVA of 20/20. Exclusion criteria for both groups were age <50 years, the presence of choroidal neovascularization, geographic atrophy (GA) or nascent GA , significant lens opacity, any corneal pathology that could compromise vision, amblyopia, diabetes, glaucoma, neurological or systemic disease affecting vision, refractive errors >6.00 dioptres (D) of spherical equivalent and >2.00 dioptres (D) of astigmatism. One eye of each patient (the one with the better visual acuity) was included in the study. If both eyes fitted the inclusion criteria and had the same visual acuity, the right eye was chosen. In addition to the functional tests spectral domain optical coherence tomography was performed using a 25° x 25° scan field (49 B-scans, automated real-time mode 20 frames, centred on the fovea) as well as fundus autofluorescence and infrared confocal scanning laser ophthalmoscopy (all with Spectralis OCT2, Heidelberg Engineering, Heidelberg, Germany) and objective refraction measurement using an autorefractor (ARK-560A; Nidek, Gamagori, Japan). All patients also underwent a clinical examination including dilated funduscopy.
Visual function tests
The following visual function tests were included: BCVA using ETDRS charts, LLVA, BCVA using MAC charts, contrast sensitivity measurement using Pelli-Robson charts, reading speed using the International Reading Speed texts (IReST) as well as mesopic and dark-adapted microperimetry using the modified MAIA “microperimeter” (S-MAIA, CenterVue, Padova, Italy). Visual acuity and functional tests were performed before fundus imaging to avoid bleaching. Patients wore their best correction for all tests except for microperimetry. BCVA was assessed according to the EDTRS method  at a testing distance of 4 m. The charts were installed in a standard light box and a subjective refraction was performed prior testing based on the values from the Nidek autorefracor. BCVA was performed with the room lights off and windows covered. The light box was illuminated with two cool daylight 20 watt fluorescent tubes. When the light box was turned on and room lights are off, background illumination of the chart was approximately 150 cd/m2. Charts 1 and 2 were used for right and left eyes respectively. To measure LLVA was measured at the same distance and with the same ETDRS charts but with a 2.0-log unit neutral density filter placed in front of the study eye that reduces luminance by 100 fold, leading to an illumination of the chart of 1.5 cd/m2, which is in the mesopic range of vision . VA measurement with the MAC charts was also performed at 4 m distance and according to EDTRS method. The MAC charts were of identical layout as the ETDRS charts except that they employed a high-contrast, high-pass letter design with a grey background of the same mean luminance as the letters. Detection and recognition threshold for these letters are almost identical under foveal viewing conditions in normal subjects. After the resolution limit is reached the letters seem to disappear, which is why the test is also called “vanishing optotypes” [19,33].
Contrast sensitivity was measured using the Pelli-Robson charts presented at 1 m distance. The charts consist of 16 triplets of 4.9 x 4.9 cm letters. Contrast decreases by a factor of 0.15 log units in each successive triplet, reading from left to right [34,35,20]. The mean chart luminance was 85 cm/m2. VA reached in the prior described visual function tests was expressed in the number of letters read. For BCVA, LLVA and MAC testing, 85 letters correspond to logMAR 0.0, and five letters correspond to one logMAR unit (i.e. 90 letters = logMAR -0.1). For the Pelli Robson charts, three letters correspond to 0.0 log contrast sensitivity unit (CS) and the maximum of 48 letters to 2.25 log CS.
To assess reading speed the IReST was used, which consists of standardized text paragraphs. Texts were presented at a viewing distance of 40 cm and size of 10-point Times New Roman font, which corresponds to normal newspaper print size . Patients wore their best near correction and were asked to read one paragraph aloud while they were timed with a stopwatch. Errors and skip of words were counted and subtracted from the total word count to compute corrected reading in words / minute according to the following formula (correctly read words/reading speed [in seconds] x 60) . All tests were performed monocularly with the other eye covered with an eye-patch.
Mesopic and dark-adapted microperimetry were then performed after pupil dilation with 1.0% tropicamide. Macular sensitivity was measured using the modified S-MAIA device, which performs fundus tracking using a line-scanning laser ophthalmoscope with a super-luminescent diode illumination with a central wave light of 850 nm. For mesopic testing, the standard white LED of the device was used and for dark-adapted red testing the additional red LED (627 nm) was used to project the stimuli. As previously described a customized stimulus grid was used that consisted of 33 points located at 0°, 1°, 3°, 5° and 7° from fixation . All patients underwent mesopic and dark-adapted microperimetry. First mesopic testing was performed, where patients were not dark-adapted and the room light was switched off just before the examination. After mesopic testing all patients underwent 30 minutes of dark adaptation while waiting in the examination room (light level < 0.1 lx). The microperimetric results were summarized as mean sensitivity (MS) in dB.
Statistical comparisons were performed using two-sided significance tests. Baseline demographic and clinical variables were summarized for each group. Due to the sample size most results were not normally distributed (tested for with the Shapiro-Wilk test) so that non-parametric tests were used for analysis. Pairwise differences were calculated using the non-parametric Wilcoxon rank sum test. A p-value < 0.05 was considered statistically significant. To ensure that the findings were not confounded by different demographic characteristics across groups, simple linear regression was performed controlling for age and sex. For each visual function test and for all combination of tests accuracy was assessed using receiver operating characteristics (ROC) curve analysis and equality of the area under the ROC curves (AUCs) of different tests and combination of tests was investigated . A ROC curve plots the sensitivity against the false-positive rate (1-specificity) in which each point reflects values obtained at a different cut-off value from–in this case–a continuous measure. The trade-off between sensitivity and specificity can be visualised on the ROC curve as the cut-off is shifted . The calculation of AUC allows comparison of discriminative ability among the different functional tests. AUC values range from 0.5 to 1.0, where 1.0 represents perfect ability to discriminate between patients with AMD and patients without AMD and 0.5 represents the discrimination resulting from pure chance . An AUC greater than 0.9 is considered excellent, greater than 0.8 to 0.9 very good, 0.6 to 0.7 average and < 0.6 poor . In addition to the ROC curves the Youden index and optimal cut-off point was determined for each visual function test. The Youden index is a commonly used measure of overall diagnostic effectiveness. The index rages between 0 and 1, with values close to 1 indicating better effectiveness and values close to 0 indicating limited effectiveness [42,43]. The cut-point that achieves this maximum is referred to as the optimal cut-point because it is the cut-point that optimizes the visual function tests’ differentiating ability when equal weight is given to sensitivity and specificity . As the functional tests are presented in different units, cut-points for combined tests cannot be reported.
Statistical analyses were performed using the statistical software STATA .
A total of 62 participants were included in the study; 38 patients with iAMD (69.1 ± 7.5 years, range 50–84, 68.4% female), and 24 controls (61.7 ± 6.1 years, range 50–73, 58.3% female). All patients underwent all study assessments. Patients’ characteristics are summarized in Table 1. Control patients were significantly younger than patients with iAMD (p < 0.05).
Functional test measures between groups
All performed visual function tests measures are given in Table 2. Boxplots in Fig 1 show the distribution over all functional tests over the two groups. All visual function test performances except the IReST were significantly decreased in the iAMD group compared to controls (p < 0.05). These effects did not alter after controlling for age and sex (Table 2).
Boxplots showing best-corrected visual acuity (BCVA), low luminance visual acuity (LLVA), visual acuity measured with the Moorfields Vanishing Optotypes Acuity Charts (MAC), contrast sensitivity measured with the Pelli-Robson contrast sensitivity test, reading speed measured with the International Reading Speed Text (IReST), mesopic and dark-adapted microperimetry for controls and intermediate AMD (iAMD). Each boxplot includes the maximum (upper whisker), upper quartile (top of the box), median (horizontal line in box), lower quartile (bottom of the box) and minimum (lower whisker) values.
The AUC values and Youden index for each visual function test are shown in Table 3. Fig 2 depicts ROC curves for all 7 visual function tests. The ROC curve for the Pelli-Robson test is closest to perfect discrimination and yields the best AUC with 0.89 and Youden index with 0.66 followed by mesopic microperimetry (AUC = 0.88, Youden index = 0.62). LLVA and MAC have equal AUC values (0.83), but LLVA has a slightly higher Youden index (0.59 vs. 0.53) followed by dark-adapted microperimetry (AUC = 0.82, Youden index = 0.53) and BCVA (AUC = 0.73, Youden index = 0.47). The ROC curve of the IReST is closest to the reference line and has an AUC of 0.64 and a Youden index of 0.28. Combined ROC analysis showed best results for the combination of LLVA and the Pelli-Robson test (AUC = 0.95), which is significantly higher than the AUCs of all single function test expect mesopic microperimetry. The MAC in combination with the Pelli-Robson test yields an AUC of 0.93. A combination of more than two tests does not improve the results, i.e. combining LLVA, MAC and the Pelli-Robson test yields an AUC of 0.95 as well (Fig 3). All other possible combinations yielded lower AUC values and were therefore not reported.
ROC curves of best-corrected visual acuity (BCVA), low luminance VA (LLVA), Moorfields Vanishing Optotypes Acuity Charts (MAC), Pelli-Robson contrast sensitivity test, reading speed with the International Reading Speed Text (IReST), mesopic and dark-adapted microperimetry. The ROC curves plots the sensitivity against the false-positive rate (1 –specificity) in which each point reflects values obtained at a different cutoff value from a continuous measure. The diagonal black line serves as a reference line since it is the ROC curve of a diagnostic test that randomly classifies the condition.
Combined ROC curves of low luminance visual acuity (LLVA) with Pelli-Robson contrast sensitivity test, combined Moorfields Vanishing Optotypes Charts (MAC) with Pelli-Robson contrast sensitivity test and all three tests combined (LLVA, MAC and Pelli Robson). The diagonal black line serves as a reference line since it is the ROC curve of a diagnostic test that randomly classifies the condition.
In this study we found visual function tests of central retinal function under low luminance and low contrast conditions to be most impacted in iAMD. Discriminating between iAMD patients and controls a combination of two simple functional tests (e.g. LLVA and Pelli Robson) yielded best results comparable to mesopic microperimetry. Thus, a combination of visual functional tests under low luminance and challenging contrast conditions seems to be the functional assessment best suited to the specific functional impairment in iAMD.
Our findings regarding BCVA and LLVA are comparable with previous studies, which reported a decreased visual function in these tests in iAMD compared to controls [46,16,8]. Wu and colleagues found BCVA, LLVA and mesopic microperimetry significantly reduced for all AMD groups except early AMD compared to controls which is in keeping with our study . Chandramohan and coworkers  did not find significant differences for contrast sensitivity between the two groups. This discrepancy to our results is likely a due to different contrast sensitivity tests: Chandramohan and colleagues used a computerized test whereas we used Pelli Robson charts. Earlier studies which also used the Pelli Robson test are comparable to our results [20,20,24,16].
In our study we also included the recently developed MAC charts. Shah et al. first demonstrated the MAC chart’s ability to detect functional loss due to AMD when BCVA tested with EDTRS charts still was unaffected . We could reproduce these findings in our study as we found significant differences in MAC-VA between iAMD and controls. Reading performance assessed with the IReST test was unable to differentiate between iAMD and controls. This in contrast to the findings from Varadaraj et al  who demonstrated that AMD patients read slower than controls when forced to read out loud. However, their study included participants with late AMD.
Although BCVA differed significantly in iAMD patients compared to controls, its AUC value was lower compared to all other function test except the IReST. Both, mesopic and dark-adapted microperimetry revealed reduced retinal sensitivity in iAMD patients compared to controls. These results are in accordance with findings from previous studies, which found mesopic microperimetry to be a good functional test in iAMD [20,48,49,12,14,37,8,50,5]. Contrary to our findings Nebbioso and colleagues reported a reduction in scotopic sensitivity but not mesopic sensitivity in patients with hard drusen . This likely is explained by the different study populations. In our sample of more advanced AMD mesopic microperimetry seemed to be a better test compared to dark-adapted microperimetry. This may be attributable to the higher variability of dark-adapted microperimetry compared to mesopic microperimetry .
Strengths of our study include the large number of visual function tests assessed including the relatively new MAC charts for which little data are available to date. Additional to several visual acuity and contrast sensitivity tests we also performed mesopic and dark-adapted microperimetry. Additional strengths are the extensive phenotyping and staging of participants using comprehensive retinal imaging in addition to a clinical assessment as well as the statistical exploration of combination of tests for better discrimination. The study is limited by the relatively small sample size as well as a lack of longitudinal data. Another limitation is the fact, that controls were significantly younger than patients. It is conceivable that a subset of eyes classified as “healthy” using the Beckman Classification is affected by pre-clinical AMD. For example, Owsley et al. could demonstrate that impaired dark-adaptation in apparently “healthy” eyes is associated with the incidence of AMD 3 years later . Moreover, Sauer et al. revealed that a subset of elderly “healthy” eyes shows subtle signatures indicative of AMD in fluorescence lifetime imaging ophthalmoscopy . Accordingly, additional longitudinal follow-up will be needed to evaluate the genuine performance of these functional tests as intended for example by the MACUSTAR consortium . In the absence of longitudinal data, however, employed means for classification are in accordance with current gold standards and published literature. With no longitudinal data, we also cannot comment on the predictive value of these tests. As common with exploratory studies, no adjustment for multiple testing was done which might lead to an over-estimation of statistical power. However, ROC analyses is unaffected by multiple testing which makes it unlikely that our findings are purely spurious.
In our study a combination of tests of central retinal function under low luminance and challenging contrast conditions seem to best capture the specific functional impairment in iAMD. These tests should be explored in longitudinal studies as to both their ability to discriminate between different AMD stages as well as to predict progression.
We thank Jeany Li, Matthias Mauschitz, Jan Terheyden, Christopher Turski and Gabrielle Turski for their support.
- 1. Wong WL, Su X, Li X, Cheung CMG, Klein R et al. (2014) Global prevalence of age-related macular degeneration and disease burden projection for 2020 and 2040. A systematic review and meta-analysis. The Lancet Global Health 2 (2): e106–e116. pmid:25104651
- 2. Vingerling JR, Dielemans I, Hofman A, Grobbee DE, Hijmering M et al. (1995) The Prevalence of Age-related Maculopathy in the Rotterdam Study. Ophthalmology 102 (2): 205–210. pmid:7862408
- 3. Colijn JM, Buitendijk GHS, Prokofyeva E, Alves D, Cachulo ML et al. (2017) Prevalence of Age-Related Macular Degeneration in Europe: The Past and the Future. Ophthalmology 124 (12): 1753–1763. pmid:28712657
- 4. Retinal Diseases in Europe. Prevalence, incidence and healthcare needs. EURETINA.
- 5. Cocce KJ, Stinnett SS, Luhmann UFO, Vajzovic L, Horne A et al. (2018) Visual Function Metrics in Early and Intermediate Dry Age-related Macular Degeneration for Use as Clinical Trial Endpoints. American Journal of Ophthalmology 189: 127–138. pmid:29477964
- 6. Scilley K, Jackson GR, Cideciyan AV, Maguire MG, Jacobson SG et al. (2002) Early age-related maculopathy and self-reported visual difficulty in daily life. Ophthalmology 109 (7): 1235–1242. pmid:12093644
- 7. Owsley C, McGwin G, JR, Scilley K, Kallies K (2006) Development of a questionnaire to assess vision problems under low luminance in age-related maculopathy. Investigative Ophthalmology & Visual Science 47 (2): 528–535.
- 8. Chandramohan A, Stinnett SS, Petrowski JT, Schuman SG, Toth CA et al. (2016) Visual function measures in early and intermediate age-related macular degeneration. Retina (Philadelphia, Pa.) 36 (5): 1021–1031.
- 9. Cassels NK, Wild JM, Margrain TH, Chong V, Acton JH (2018 Jan—Feb) The use of microperimetry in assessing visual function in age-related macular degeneration. United States.
- 10. Owsley C, Huisingh C, Jackson GR, Curcio CA, Szalai AJ et al. (2014) Associations between abnormal rod-mediated dark adaptation and health and functioning in older adults with normal macular health. Investigative Ophthalmology & Visual Science 55 (8): 4776–4789.
- 11. Dimitrov PN, Robman LD, Varsamidis M, Aung KZ, Makeyeva GA et al. (2011) Visual function tests as potential biomarkers in age-related macular degeneration. Investigative Ophthalmology & Visual Science 52 (13): 9457–9469.
- 12. Wu Z, Ayton LN, Guymer RH, Luu CD (2013) Intrasession test-retest variability of microperimetry in age-related macular degeneration. Investigative Ophthalmology & Visual Science 54 (12): 7378–7385.
- 13. McKeague C, Binns AM, Margrain TH (2014) An evaluation of two candidate functional biomarkers for AMD. Optometry and vision science: official publication of the American Academy of Optometry 91 (8): 916–924.
- 14. Wu Z, Ayton LN, Guymer RH, Luu CD (2014) Low-luminance visual acuity and microperimetry in age-related macular degeneration. Ophthalmology 121 (8): 1612–1619. pmid:24661863
- 15. Puell MC, Barrio AR, Palomo-Alvarez C, Gomez-Sanz FJ, Clement-Corral A et al. (2012) Impaired mesopic visual acuity in eyes with early age-related macular degeneration. Investigative Ophthalmology & Visual Science 53 (11): 7310–7314.
- 16. Feigl B, Brown B, Lovie-Kitchin J, Swann P (2004) Cone-mediated multifocal electroretinogram in early age-related maculopathy and its relationships with subjective macular function tests. Current Eye Research 29 (4–5): 327–336. pmid:15590480
- 17. Sunness JS, Rubin GS, Broman A, Applegate CA, Bressler NM et al. (2008) Low luminance visual dysfunction as a predictor of subsequent visual acuity loss from geographic atrophy in age-related macular degeneration. Ophthalmology 115 (9): 1480–8, 1488.e1-2. pmid:18486216
- 18. Kleiner RC, Enger C, Alexander MF, Fine SL (1988) Contrast sensitivity in age-related macular degeneration. Archives of ophthalmology (Chicago, Ill.: 1960) 106 (1): 55–57.
- 19. Shah N, Dakin SC, Dobinson S, Tufail A, Egan CA et al. (2016) Visual acuity loss in patients with age-related macular degeneration measured using a novel high-pass letter chart. The British journal of ophthalmology 100 (10): 1346–1352. pmid:26846435
- 20. Maynard ML, Zele AJ, Feigl B (2016) Mesopic Pelli-Robson contrast sensitivity and MP-1 microperimetry in healthy ageing and age-related macular degeneration. Acta ophthalmologica 94 (8): e772–e778. pmid:27225020
- 21. Faria BM, Duman F, Zheng CX, Waisbourd M, Gupta L et al. (2015) Evaluating contrast sensitivity in age-related macular degeneration using a novel coputer-based test, the Spaeth/Richman contrast sensitivity test. Retina (Philadelphia, Pa.) 35 (7): 1465–1473.
- 22. Sato T, Suzuki M, Ooto S, Spaide RF (2015) Multimodal Imaging Findings and Multimodal Vision Testing in Neovascular Age-Related Macular Degeneration. Retina (Philadelphia, Pa.) 35 (7): 1292–1302.
- 23. Barteselli G, Gomez ML, Doede AL, Chhablani J, Gutstein W et al. (2014) Visual function assessment in simulated real-life situations in patients with age-related macular degeneration compared to normal subjects. Eye (London, England) 28 (10): 1231–1238.
- 24. Feigl B, Brown B, Lovie-Kitchin J, Swann P (2005) Monitoring retinal function in early age-related maculopathy: visual performance after 1 year. Eye (London, England) 19 (11): 1169–1177.
- 25. Feigl B, Greaves A, Brown B (2007) Functional outcomes after multiple treatments with ranibizumab in neovascular age-related macular degeneration beyond visual acuity. Clinical ophthalmology (Auckland, N.Z.) 1 (2): 167–175.
- 26. Vujosevic S, Smolek MK, Lebow KA, Notaroberto N, Pallikaris A et al. (2011) Detection of macular function changes in early (AREDS 2) and intermediate (AREDS 3) age-related macular degeneration. Ophthalmologica. Journal international d'ophtalmologie. International journal of ophthalmology. Zeitschrift fur Augenheilkunde 225 (3): 155–160. pmid:21150232
- 27. Wu Z, Ayton LN, Luu CD, Guymer RH (2015) Longitudinal changes in microperimetry and low luminance visual acuity in age-related macular degeneration. JAMA ophthalmology 133 (4): 442–448. pmid:25632841
- 28. Tran BK, Herbort CP, JR (2015) Discrepancy between Visual Acuity and Microperimetry in AMD Patients: Visual Acuity Appears as an Inadequate Parameter to Test Macular Function. KLINISCHE MONATSBLATTER FUR AUGENHEILKUNDE 232 (4): 529–532. pmid:25902114
- 29. Vujosevic S, Pucci P, Casciano M, Longhin E, Convento E et al. (2016) Long-term longitudinal modifications in mesopic microperimetry in early and intermediate age-related macular degeneration. Graefe's archive for clinical and experimental ophthalmology = Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie.
- 30. Ferris FL3, Wilkinson CP, Bird A, Chakravarthy U, Chew E et al. (2013) Clinical classification of age-related macular degeneration. Ophthalmology 120 (4): 844–851. pmid:23332590
- 31. Wu Z, Luu CD, Ayton LN, Goh JK, Lucci LM et al. (2015) Fundus autofluorescence characteristics of nascent geographic atrophy in age-related macular degeneration. Investigative Ophthalmology & Visual Science 56 (3): 1546–1552.
- 32. Ferris FL 3rd., Kassoff A, Bresnick GH, Bailey I (1982) New Visual Acuity Charts for Clinical Research. American Journal of Ophthalmology 94 (1): 91–96. pmid:7091289
- 33. Campbell FW, Gubisch RW (1966) Optical quality of the human eye. The Journal of physiology 186 (3): 558–578. pmid:5972153
- 34. Pelli DG, Robson JG, Wilkins AJ (1988) The design of a new letter chart for measuring contrast sensitivty. Clin Vis Sci 2 (3): 187–199.
- 35. Mantyjarvi M, Laitinen T (2001) Normal values for the Pelli-Robson contrast sensitivity test. Journal of Cataract and Refractive Surgery 27 (2): 261–266. pmid:11226793
- 36. Trauzettel-Klosinski S, Dietz K (2012) Standardized assessment of reading performance: the New International Reading Speed Texts IReST. Investigative Ophthalmology & Visual Science 53 (9): 5452–5461.
- 37. Welker SG, Pfau M, Heinemann M, Schmitz-Valckenberg S, Holz FG et al. (2018) Retest Reliability of Mesopic and Dark-Adapted Microperimetry in Patients With Intermediate Age-Related Macular Degeneration and Age-Matched Controls. Investigative Ophthalmology & Visual Science 59 (4): AMD152–AMD159.
- 38. Mario A Cleves (2002) From the help desk: Comparing areas under receiver operating characteristics curves from two or more probit or logit models. The Stata Journal (3): 301–313.
- 39. Metz CE (1978) Basic principles of ROC analysis. Seminars in nuclear medicine 8 (4): 283–298. pmid:112681
- 40. Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143 (1): 29–36. pmid:7063747
- 41. Choi BC (1998) Slopes of a receiver operating characteristic curve and likelihood ratios for a diagnostic test. American journal of epidemiology 148 (11): 1127–1132. pmid:9850136
- 42. Fluss R, Faraggi D, Reiser B (2005) Estimation of the Youden Index and its associated cutoff point. Biometrical journal. Biometrische Zeitschrift 47 (4): 458–472. pmid:16161804
- 43. Schisterman EF, Perkins NJ, Liu A, Bondell H (2005) Optimal cut-point and its corresponding Youden Index to discriminate individuals using pooled blood samples. Epidemiology (Cambridge, Mass.) 16 (1): 73–81.
- 44. Ruopp MD, Perkins NJ, Whitcomb BW, Schisterman EF (2008) Youden Index and optimal cut-point estimated from observations affected by a lower limit of detection. Biometrical journal. Biometrische Zeitschrift 50 (3): 419–430. pmid:18435502
- 45. StataCorp. 2017. Stata Statistical Software: Release 15. College Station, TX: StataCorp LLC. Available: https://www.stata.com/.
- 46. Wu Z, Guymer RH, Finger RP (2016) Low luminance deficit and night vision symptoms in intermediate age-related macular degeneration. The British journal of ophthalmology 100 (3): 395–398. pmid:26250520
- 47. Varadaraj V, Lesche S, Ramulu PY, Swenor BK (2018) Reading Speed and Reading Comprehension in Age-related Macular Degeneration. American Journal of Ophthalmology 186: 138–143. pmid:29246579
- 48. Steinberg JS, Fitzke FW, Fimmers R, Fleckenstein M, Holz FG et al. (2015) Scotopic and Photopic Microperimetry in Patients With Reticular Drusen and Age-Related Macular Degeneration. JAMA ophthalmology 133 (6): 690–697. pmid:25811917
- 49. Wu Z, Cunefare D, Chiu E, Luu CD, Ayton LN et al. (2016) Longitudinal Associations Between Microstructural Changes and Microperimetry in the Early Stages of Age-Related Macular Degeneration. Investigative Ophthalmology & Visual Science 57 (8): 3714–3722.
- 50. Dinc UA, Yenerel M, Gorgun E, Oncel M (2008) Assessment of macular function by microperimetry in intermediate age-related macular degeneration. EUROPEAN JOURNAL OF OPHTHALMOLOGY 18 (4): 595–600. pmid:18609481
- 51. Nebbioso M, Barbato A, Pescosolido N (2014) Scotopic microperimetry in the early diagnosis of age-related macular degeneration: preliminary study. BIOMED RESEARCH INTERNATIONAL 2014: 671529. pmid:25548774
- 52. Owsley C, McGwin G, JR, Clark ME, Jackson GR, Callahan MA et al. (2016) Delayed Rod-Mediated Dark Adaptation Is a Functional Biomarker for Incident Early Age-Related Macular Degeneration. Ophthalmology 123 (2): 344–351. pmid:26522707
- 53. Sauer L, Gensure RH, Andersen KM, Kreilkamp L, Hageman GS et al. (2018) Patterns of Fundus Autofluorescence Lifetimes In Eyes of Individuals With Nonexudative Age-Related Macular Degeneration. Investigative Ophthalmology & Visual Science 59 (4): AMD65–AMD77.
- 54. Finger RP, Schmitz-Valckenberg S, Schmid M, Rubin GS, Dunbar Het al. (2019) MACUSTAR: Development and Clinical Validation of Functional, Structural, and Patient-Reported Endpoints in Intermediate Age-Related Macular Degeneration. Ophthalmologica 241 (2): 61–72. pmid:30153664