Blindness in Sudan: Is It Time to Scrutinise Survey Methods?

Kuper and Gilbert discuss the limitations of a new survey of blindness in a war-torn area in southern Sudan, published in PLoS Medicine.


Perspectives
December 2006 | Volume 3 | Issue 12 | e476 T hose who have been involved in surveys, particularly in developing countries, will agree that doing a survey is a challenging undertaking. Conducting surveys entails explaining the purpose and procedures in understandable language, walking around villages through rain or sun, and coaxing resistant people into being examined. This must all be done while adhering to strict research protocols, carrying out the enumeration meticulously and the examinations with patience and care. Surveys are all the more diffi cult in low-income settings where experienced staff and sampling frames for enumeration may not be available. We therefore applaud the efforts of Ngondi and colleagues in carrying out a survey of blindness in a war-torn area in southern Sudan, which is published in PLoS Medicine [1].
Estimates from the survey suggest that the prevalence of blindness in people over fi ve years old was 4.1%, which is far higher than previously reported for Africa [2]. The prevalence also vastly exceeds the World Health Organization estimate, based on data from across the continent, that 1% of people in Africa are blind [3]. Should the results of this survey be a cause for utter despair, or should we instead scrutinise the survey methodology?

A Comparison with Other Surveys
Without doubt the conditions in this area in southern Sudan are dire, and the survey had to use the personnel available. However, surveys conducted in other severely underserved or postconfl ict areas in Africa show a far lower prevalence of blindness. For instance, a survey conducted in 1998 in a rural area of the Democratic Republic of Congo estimated that only 0.5% of surveyed people over 10 years old were blind in both eyes [4].
Perhaps the high prevalence found by Ngondi and colleagues is because the people in southern Sudan are particularly vulnerable to eye disease? The leading cause of blindness in their survey was cataract (which occurs all over the world), responsible for 41% of cases, followed by trachoma (an infectious disease found mainly in Africa), causing 35% of cases. A recent survey in Ethiopia in an area hyperendemic for trachoma found a similar proportion of blindness due to trachoma (23%), but with a far lower prevalence of blindness overall (8% in people aged over 40 years compared to 23% in the over 50s in southern Sudan) [5]. Even areas endemic for onchocerciasis (another infectious cause of blindness) in Central African Republic, where almost three quarters of cases of blindness are due to onchocerciasis, report about half the prevalence of blindness observed in the southern Sudan survey [6].
Aside from the high prevalence of blindness, the distribution of blindness within the population of southern Sudan was also unusual. Among the people enumerated aged over 50 years it was rare to fi nd someone without visual impairment, as only 17% of women and 32% of men aged over 50 years had normal vision in both eyes. Moreover, the typical ratio of blindness to low vision for Africa is about 1:3 [3], whereas in the survey in southern Sudan a ratio of 1:2 was reported.
Populations usually experience about twice as much unilateral blindness as bilateral blindness, but in the southern Sudan survey the number of people blind in both eyes was approximately the same as those blind in one eye only.

Sources of Bias
Taking these pieces of evidence together it seems likely that in Ngondi and colleagues' survey blind people were over-sampled, or blindness was over-diagnosed, or the normally sighted were no longer living in the area. There are two essential steps to conducting a survey. The fi rst is the selection of participants and the second is determining whether or not they have the disease of interest, in this case blindness. Biases can occur at either of these steps.
The integrated eye care workers (IECWs) who carried out the survey had previously worked in an eye surgery camp, where the whole purpose is to fi nd as many blind people as possible. Surveys require a totally different approach, and it may have been diffi cult for the IECWs not to include blind people who had been denied eye care for so very long. Alternatively the bias may have occurred through the use of the random walk methodology (see sidebar), as the authors acknowledge. The random walk method allows

Blindness in Sudan: Is It Time to Scrutinise Survey Methods? Hannah Kuper * , Clare Gilbert
The Perspectives section is for experts to discuss the clinical practice or public health implications of a published article that is freely available online.

Random Walk
The random walk method is a technique for sampling households in a door to door survey. Starting at a central place in the village, a random direction is chosen (e.g., by spinning a bottle). A household is chosen at random among those along the line from the centre to the edge of the village. The next closest household is visited, in turn, until the cluster has been completed.
an element of subjectivity in the selection of households for the survey. Blindness is almost unique among diseases as it can be diagnosed by people in the village (one does not have to be a health professional to suspect blindness). The village guides accompanying the teams know that the teams are looking for blind people and they also know where these blind people live. This makes it diffi cult to stop "helpful" village guides from steering enumeration teams towards blind people.
The other type of bias can occur during the eye examination. Measuring visual acuity is diffi cult and needs the right conditions, such as suffi cient light, lack of glare, and few distractions. The IECWs may not have been highly experienced at measuring visual acuity, and it is not clear how much they were supervised in the fi eld. Errors in measuring visual acuity occur when normally sighted people misread the charts (by accident or through poor conditions) and are labelled as visually impaired. In contrast, blind people cannot achieve good vision and read the charts correctly. The bias is, therefore, only in the direction of overestimation.

Interpreting the New Survey
This leaves us with two possible interpretations. The fi rst is that the prevalence of blindness in this survey has been over-estimated, perhaps because enumeration or visual acuity measurements were not undertaken to the standards required. The second is that these prevalence estimates are accurate, and refl ect large-scale outmigration from the area (including death) of those with normal vision.
Putting aside the methodological fl aws in the survey, the prevalence of blindness is outside the range previously reported, and the pattern of eye disease observed is highly unusual. It is, of course, likely that blindness is a serious problem in southern Sudan and another survey to confi rm the very high prevalence is indicated.