Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Validation of 2006 WHO Prediction Scores for True HIV Infection in Children Less than 18 Months with a Positive Serological HIV Test

Validation of 2006 WHO Prediction Scores for True HIV Infection in Children Less than 18 Months with a Positive Serological HIV Test

  • Cécile Alexandra Peltier, 
  • Christine Omes, 
  • Patrick Cyaga Ndimubanzi, 
  • Gilles François Ndayisaba, 
  • Sara Stulac, 
  • Vic Arendt, 
  • Olivier Courteille, 
  • Narcisse Muganga, 
  • Kizito Kayumba, 
  • Jef Van den Ende
PLOS
x

Abstract

Introduction

All infants born to HIV-positive mothers have maternal HIV antibodies, sometimes persistent for 18 months. When Polymerase Chain Reaction (PCR) is not available, August 2006 World Health Organization (WHO) recommendations suggest that clinical criteria may be used for starting antiretroviral treatment (ART) in HIV seropositive children <18 months. Predictors are at least two out of sepsis, severe pneumonia and thrush, or any stage 4 defining clinical finding according to the WHO staging system.

Methods and Results

From January 2005 to October 2006, we conducted a prospective study on 236 hospitalized children <18 months old with a positive HIV serological test at the national reference hospital in Kigali. The following data were collected: PCR, clinical signs and CD4 cell count.

Current proposed clinical criteria were present in 148 of 236 children (62.7%) and in 95 of 124 infected children, resulting in 76.6% sensitivity and 52.7% specificity. For 87 children (59.0%), clinical diagnosis was made based on severe unexplained malnutrition (stage 4 clinical WHO classification), of whom only 44 (50.5%) were PCR positive. Low CD4 count had a sensitivity of 55.6% and a specificity of 78.5%.

Conclusion

As PCR is not yet widely available, clinical diagnosis is often necessary, but these criteria have poor specificity and therefore have limited use for HIV diagnosis. Unexplained malnutrition is not clearly enough defined in WHO recommendations. Extra pulmonary tuberculosis (TB), almost impossible to prove in young children, may often be the cause of malnutrition, especially in HIV-affected families more often exposed to TB. Food supplementation and TB treatment should be initiated before starting ART in children who are staged based only on severe malnutrition.

Introduction

Half of human immunodeficiency virus (HIV) infected children in resource limited countries will die before 2 years of age if antiretroviral treatment (ART) is not available [1]. Without polymerase chain reaction (PCR), early diagnosis of HIV in young children is a real challenge, as all infants born to HIV positive mothers have maternal HIV antibodies crossing the placental barrier, sometimes persisting up to the age of 18 months [2]. Definitive diagnosis of HIV infection is only possible using advanced technical approaches such as PCR to confirm presence of the virus in the blood [3]. In recent years, HIV PCR (DNA or RNA) has become more accessible for resource limited countries: blood specimen sampling, storage and transport have been simplified with the use of dried blood spot [4] and prices are decreasing with the introduction of real time PCR [5]. However, the equipment remains expensive and requires highly trained laboratory technicians. Other diagnostic techniques are being developed, such as detection of immune-complex dissociated P24, but have not been widely applied or validated [6]. In the immediate future, HIV PCR will not be available throughout most resource limited countries. The possibility of treating children having positive clinical signs and a positive HIV serological test, without the obligation of doing PCR is an important opportunity [7], preventing children from dying in places where ART is already available and free of charge, but where diagnostic PCR is not. These problems primarily affect African countries, and 420 000 children are newly infected every year worldwide [8].

In December 2004, the World Health Organisation (WHO) first proposed using clinical criteria to diagnose HIV infection and to recommend ART for children under 18 months old, first as Web-based drafts, and finally reported as the 2005 WHO clinical staging system [9]. The criteria proposed considering a child less than 18 months old infected if a HIV serological test was positive (indicating either exposure or infection) and if two of the following clinical signs were present: sepsis, severe pneumonia, thrush or severe malnutrition. At the Toronto 2006 AIDS conference, a sensitivity of 68.8% and a specificity of 74.1% for HIV infection were reported using these criteria [10].

Criteria were slightly modified in the latest paediatric WHO guidelines published in August 2006 [11] after the Toronto conference, but specificity and sensitivity have not yet been evaluated and were not modified by the latest WHO technical group which met in Geneva in April 2008 [12]. At this meeting, an important decision was made to initiate ART for all HIV infected or clinically suspected (according to the criteria evaluated in this article) children under the age of one year.

These 2006 criteria suggest that ART should be initiated if HIV seropositive children <18 months have two or more of the following clinical signs: sepsis, severe pneumonia, thrush or any WHO stage 4 clinical signs (Box S1).

Immune depression indicated by CD4 <25% for children ≤11 months old, and CD4 <20% for children between 12 and 18 months is also a factor for diagnosis of HIV infection apart from clinical criteria [11].

This study intends to compare the latest WHO (August 2006) clinical and immunological criteria for HIV infection in children less than 18 months with previous criteria, as well as to evaluate the sensitivity and specificity of low CD4 cell counts for HIV diagnosis, all with HIV PCR (DNA) as the gold standard.

We also discuss recommendations to improve the specificity of these indispensable clinical scores, since universal access to PCR remains far from reality.

Materials and Methods

In this prospective study we included all HIV seropositive children <18 months old admitted between January 2005 and December 2007 to the paediatric ward of the “Centre Hospitalier Universitaire de Kigali” (CHUK), a national reference teaching hospital in Rwanda. Serostatus was analyzed with a first positive serological rapid test (First Response, PMC Medical, Daman, India), and confirmed with a second rapid test (Unigold, Trinity Biotech plc, Wicklow, Ireland). In the case of discordant results, a third rapid test (Capillus, Trinity Biotech plc, Wicklow, Ireland) was added. The following data were collected: DNA PCR (Amplicor version 1.5, Roche Molecular Systems, Pleasanton, CA), clinical signs, and absolute and/or relative CD4 cell count. In the case of lack of reagents or other logistical problems, blood was preserved in order to collect all data on a single day. Each child was considered only once, even if hospitalised several times.

Until July 2005, absolute CD4 cell counts were measured with a Cyflow counter (Partec, Munster, Germany). Relative CD4 cell counts were estimated by the following algorithm: CD4 <1500 = CD4 <25% for children ≤11 months old, and CD4 <750 = CD4 <20% for children between 12 and 18 months old [11].

Starting in August 2005, absolute and relative CD4 cell counts were done with FACSCalibur (BD Bioscience, Becton, Dickinson and company, USA).

Severe malnutrition was determined as weight for age ≤3 Z scores (WHO international weight and length charts [13] ) or weight for height <70% [14]. AIDS-defining opportunistic infections (stage 4) were prospectively recorded (Box S2). Sepsis was diagnosed by the presence of fever and at least two of the following clinical signs: pulse >180/minute, respiratory rate >40/minute, capillary refill >3 seconds. Oxygen, IV antibiotics and volume expansion were given. The diagnosis of severe pneumonia was based on chest X-ray and oxygen requirement. Definition of oral candidiasis (thrush) relied on clinical observation of white creamy small plaques in the mouth [11].

Clinical values and immunological results were compared to the results of PCR, which has reported 98% sensitivity and specificity for infected children after the age of four weeks [15]. For statistical analyses we relied on Microsoft Office Excel 2003 (Microsoft Corporation, Redmond, Washington) and SPSS (SPPS inc. 14.0.0, Chicago, Illinois).

We received ethical approval for this study from the Research Board of CHUK, recognized by the national ethical committee. Only interventional studies or studies requiring examinations not included in routine work-up would have required referral to the national ethics committee. All hospitalized children in Rwanda are offered routine HIV testing after counselling of parents or legal guardians; no written consent is performed. This corresponds to Rwanda's national recommendations for scaling-up of HIV testing of children. For collecting these data, no additional blood samples or extra physical examinations were performed. The analyses of these data are done with identification numbers corresponding to each patient to preserve patient anonymity.

Results

Two hundred and thirty six children matched the study inclusion criteria; 105 children were female, 131 were male, and the median age was 9 months (20 days to 18 months old). 124 of 236 (52.5%) of children were confirmed to be infected with HIV using HIV DNA PCR (Table 1). Half of the children (123/236, 52.1%) had severe unexplained malnutrition corresponding to WHO clinical stage 4 (Box S2), whereas septicaemia, pneumonia or thrush were present in 28.0%, 42.0% and 36.0% respectively. Seventy nine percent of children were in WHO stage 3 or 4, and 39.4% had low CD4 cell counts (Table 1).

thumbnail
Table 1. Characteristics of 236 hospitalized children under 18 months old with an HIV-1 serological positive test in Rwanda.

https://doi.org/10.1371/journal.pone.0005312.t001

Logistic regression of predictors for HIV infection in children <18 months showed significance for WHO clinical criteria, CD4 cell counts and age, but not for sex (Table 2). One hundred and forty eight children (62.7%) displayed WHO 2006 clinical HIV-defining criteria, of which 87 (58.7%) met 2006 criteria based on unexplained severe malnutrition alone. Only 44 (50.5%) of these severely malnourished children were PCR positive.

thumbnail
Table 2. Logistic regression of individual predictors for HIV infection in children <18 months.

https://doi.org/10.1371/journal.pone.0005312.t002

Clinical 2006 WHO criteria had a sensitivity of 76.6% and a specificity of 52.7%.

Using 2005 interim WHO clinical criteria would have resulted in a sensitivity of 68.5% and a specificity of 71.4% (Table 3). Low CD4 cell counts had a sensitivity of 55.6% and a specificity of 78.5%, with a positive predictive value (PPV) of 74.2% and a negative predictive value (NPV) of 61.5%. Combining clinical criteria with CD4 cell count resulted in sensitivity of 88.7% and specificity of 42.9%, and combining them with age >12 months gave sensitivity of 83.9% and specificity of 45.5% (Table 3).

thumbnail
Table 3. Sensitivity and specificity of different WHO presumptive diagnostic alternatives of HIV infection in children <18 months with a positive serological test for HIV in Rwanda.

https://doi.org/10.1371/journal.pone.0005312.t003

McNemar testing of differences in sensitivities and specificities showed significance for all paired comparisons.

Discussion

This study evaluated the revised WHO algorithm for predicting HIV infection in children under 18 months old. Comparing the WHO 2005 interim clinical presumptive diagnosis guidelines with the August 2006 guidelines, the new guidelines gained in sensitivity but lost in specificity, mainly due to the inclusion of severe unexplained malnutrition as a stage 4-defining criterion, for which ART is recommended. More HIV uninfected children risk incorrectly receiving ART because of “unexplained malnutrition”. Many of these infants are also exposed to poverty and tuberculosis (TB), conditions that also lead to malnutrition [16][18] .

CD4 cell count and total lymphocyte count are known to have a low sensitivity for HIV infection; this was also observed for CD4 cell counts in our cohort. Low CD4 cell counts and low total lymphocyte counts are known markers of progression leading to mortality in resource–rich countries [19] and have already been evaluated as markers indicating need to start ART in resource limited countries [20] but have not been evaluated as markers of infection for children under 18 months old. We did not include the evaluation of low lymphocyte count in this study given the extremely low predictive value found hitherto. The method of extrapolation of CD4 cell percentage based on absolute CD4 cell count risks misclassification of children with lymphopenia or lymphocytosis. Severe malnutrition can also influence CD4 cell values and could have an effect on the predictive value of CD4 cell counts for HIV infection, as 52.1% of our children were severely malnourished.

Adding CD4 cell count to the WHO clinical criteria increases the sensitivity of HIV diagnosis, but lowers the specificity considerably. This study shows that an alternative: adding persistent anti-HIV antibodies at ages over 12 months as a predictor, also increases sensitivity and lowers specificity, but to a minor degree (Table 3).

Could the study's setting in a reference hospital have influenced the results, making them difficult to apply to other situations? The population of children hospitalized at a tertiary level is generally more seriously ill, increasing the sensitivity of the clinical scores. But university and other reference hospitals in developing countries almost always also serve as district hospitals for the city; only a minority of the patients was truly referred in 2005. In addition, the country's poverty could have had the same effect, but WHO guidelines were conceived for countries where PCR is not available, which are mainly poor to very poor settings.

One important confounding factor for clinical diagnosis of HIV in children is tuberculosis, as children born into HIV-affected families are more frequently exposed to TB [21]. Young children infected with TB can be stunted, with malnutrition-related immune depression clinical signs including sepsis, thrush and pneumonia, and may also be anergic to PPD [22]. Malnourished children also have severe cellular immunodeficiency [23].

Tuberculosis is extremely difficult to diagnose in young children [24], and disseminated and extra-pulmonary tuberculosis occur more frequently than in adults [25]. Mycobacterium blood culture, PCR, and bronchoalveolar lavage and cultures are rarely available in resource limited settings. Moreover, the yield of microscopic examination of gastric fluid samples for acid fast bacilli is low (5 to 10%) [26] even when advanced laboratory tests are available. Children with severe malnutrition do not present with classic inflammatory signs of tuberculosis infection [27] such as cough, fever, enlarged lymph nodes and positive X-rays [28]. A mortality rate of up to 40% for children co-infected with HIV and tuberculosis has been reported [29].

Clinical scores and empiric TB treatment are not described in the WHO definition for unexplained malnutrition. Without clearly defining a method for excluding TB, “unexplained” stunting will be overestimated. In countries where the epidemics of tuberculosis and HIV exist concurrently, confusion between the two diseases will continue to be a reality [30]. Treating HIV with ART without first initiating TB treatment in children harbouring both infections can lead to fulminant tuberculosis as part of immune reconstitution inflammatory syndrome. Worse, treating an HIV suspected but actually HIV negative child with ART bears the risk of overlooking TB as the true diagnosis [31].

Future research could evaluate the following strategy, in use in Rwanda since this study: Children under 18 months old with a positive HIV serological test, who meet WHO criteria for initiating ART based only on severe unexplained malnutrition, should be started for one month on food supplementation and empiric TB treatment. Initiation of ART could then be based on the child's response to these interventions to exclude malnutrition due to food insufficiency and TB.

Based on the results of the CHER study [32], WHO recently [12] recommended systematic ART for all infected or even clinically suspected children under 12 months if PCR is not available, irrespective of CD4 or clinical stage [32]. This study demonstrated lower overall mortality in the ART group.

As clinicians, we hope to be able to continue saving children's lives, even when lacking the technology for clinical diagnosis. We should evaluate the clinical response to food supplementation and empiric TB treatment, and validate clinical scoring using this algorithm, to improve the specificity of actual HIV clinical signs. In the meantime, scaling up access to HIV PCR testing is urgently needed.

Using revised August 2006 WHO criteria for diagnosis of HIV infection in children under 18 months results in a 53.6% specificity, 17.7% lower than the 2005 WHO clinical guidelines, merely due to the acceptance of unexplained severe malnutrition as a single criterion defining stage 4 HIV infection. Although 3/4 of infected children were detected by clinical criteria alone, we would have treated 46.4% of uninfected children without the availability of PCR. Beyond the cost and risks of treating uninfected children, this also may lead clinicians to fail to diagnose other existing conditions, especially TB.

The low diagnostic accuracy of these clinical criteria and of CD4 cell count emphasizes the urgent need for availability of HIV PCR testing in low resource countries and for better diagnostic tools for tuberculosis in young children.

Supporting Information

Box S1.

Reminder of latest WHO guidelines: Antiretroviral therapy of HIV infection in infants and children in resource-limited settings: toward universal access 2006 (Page 22).

https://doi.org/10.1371/journal.pone.0005312.s001

(0.03 MB DOC)

Box S2.

Reminder of latest WHO guidelines: Antiretroviral therapy of HIV infection in infants and children in resource-limited settings: toward universal access 2006 (Page 85).

https://doi.org/10.1371/journal.pone.0005312.s002

(0.03 MB DOC)

Acknowledgments

Patients (children and parents), nurses, counselors, and doctors working in the Department of Pediatrics at CHUK.

Author Contributions

Conceived and designed the experiments: CAP PCN VA JVdE. Performed the experiments: PCN OC. Analyzed the data: CAP PCN GFN KK JVdE. Contributed reagents/materials/analysis tools: CAP CO. Wrote the paper: CAP CO GFN SS VA NM JVdE.

References

  1. 1. Newell ML, Coovadia H, Cortina-Borja M, Rollins N, Gaillard P, et al. (2004) Mortality of infected and uninfected infants born to HIV-infected mothers in Africa: a pooled analysis. Lancet 364: 1236–1243.
  2. 2. Chantry CJ, Cooper ER, Pelton SI, Zorilla C, Hillyer GV, et al. (1995) Seroreversion in human immunodeficiency virus-exposed but uninfected infants. Pediatr Infect Dis J 14: 382–387.
  3. 3. Rouet F, Sakarovitch C, Msellati P, Elenga N, Montcho C, et al. (2003) Pediatric viral human immunodeficiency virus type 1 RNA levels, timing of infection, and disease progression in African HIV-1-infected children. Pediatrics 112: e289.
  4. 4. Fischer A, Lejczak C, Lambert C, Servais J, Makombe N, et al. (2004) Simple DNA extraction method for dried blood spots and comparison of two PCR assays for diagnosis of vertical human immunodeficiency virus type 1 transmission in Rwanda. J Clin Microbiol 42: 16–20.
  5. 5. Desire N, Dehee A, Schneider V, Jacomet C, Goujon C, et al. (2001) Quantification of human immunodeficiency virus type 1 proviral load by a TaqMan real-time PCR assay. J Clin Microbiol 39: 1303–1310.
  6. 6. Sherman GG, Stevens G, Stevens WS (2004) Affordable diagnosis of human immunodeficiency virus infection in infants by p24 antigen detection. Pediatr Infect Dis J 23: 173–176.
  7. 7. Gortmaker SL, Hughes M, Cervia J, Brady M, Johnson GM, et al. (2001) Effect of combination therapy including protease inhibitors on mortality among children and adolescents infected with HIV-1. N Engl J Med 345: 1522–1528.
  8. 8. WHO (2007) Epiupdate
  9. 9. WHO (2005) Interim WHO clinical staging of HIV/AIDS and HIV/AIDS case definitions for surveillance. African Region.
  10. 10. Peltier CA, N.Cyaga P, Mukherjee J (2006) New challenge for Countries with limited resources: early diagnosis of HIV infection for children under 18 months - First evaluation of WHO clinical diagnosis proposed in December 2004 (revised in november 2005) on 106 children in Kigali/Rwanda. IAS Conference, Toronto, Canada August 13–18: Poster MOPE0093.
  11. 11. WHO (2006) Antiretroviral Therapy of HIV infection in infants and children in Ressource-limited settings: toward universal Access
  12. 12. WHO Technical Reference Group (2008) Paediatric HIV care art guideline review meeting
  13. 13. WHO (2006) New international Child Growth Standards
  14. 14. Société canadienne de pédiatrie (2004) L'utilisation des courbes de croissance pour évaluer et surveiller la croissance des nourrissons et des enfants canadiens :Un résumé. Paediatr Child Health 9: 181–183.
  15. 15. Sherman GG, Cooper PA, Coovadia AH, Puren AJ, Jones SA, et al. (2005) Polymerase chain reaction for diagnosis of human immunodeficiency virus infection in infancy in low resource settings. Pediatr Infect Dis J 24: 993–997.
  16. 16. Bachou H, Tylleskar T, Kaddu-Mulindwa DH, Tumwine JK (2006) Bacteraemia among severely malnourished children infected and uninfected with the human immunodeficiency virus-1 in Kampala, Uganda. BMC Infect Dis 6: 160.
  17. 17. Paillaud E, Merlier I, Dupeyron C, Scherman E, Poupon J, et al. (2004) Oral candidiasis and nutritional deficiencies in elderly hospitalised patients. Br J Nutr 92: 861–867.
  18. 18. WHO (2007) Chapter 4: childhood contact screening and management. World Health Organization Stop TB Partnership Childhood TB Subgroup. Int J Tuberc Lung Dis 11: 12–15.
  19. 19. HIV Paediatric Prognostic Markers Collaborative Study (2005) A meta-analysis of longitudinal data: Use of total lymphocyte count for informing when to start antiretroviral therapy in HIV-infected children. Lancet 366: 1868–1874.
  20. 20. Badri M, Wood R (2003) Usefulness of total lymphocyte count in monitoring highly active antiretroviral therapy in resource-limited settings. AIDS 17: 541–545.
  21. 21. Singh M, Mynak ML, Kumar L, Mathew JL, Jindal SK (2005) Prevalence and risk factors for transmission of infection among children in household contact with adults having pulmonary tuberculosis. Arch Dis Child 90: 624–628.
  22. 22. Satyanarayana K, Bhaskaram P, Seshu VC, Reddy V (1980) Influence of nutrition on postvaccinial tuberculin sensitivity. Am J Clin Nutr 33: 2334–2337.
  23. 23. Bachou H, Tylleskar T, Downing R, Tumwine JK (2006) Severe malnutrition with and without HIV-1 infection in hospitalised children in Kampala, Uganda: differences in clinical features, haematological findings and CD4+ cell counts. Nutr J 5: 27.
  24. 24. WHO (2006) Chapter 1: Introduction and diagnosis of tuberculosis in children. Stop TB Partnership Childhood TB Subgroup World Health Organization. Int J Tuberc Lung Dis 10: 1067.
  25. 25. Prazuck T, Tall F, Nacro B, Rochereau A, Traore A, et al. (1993) HIV infection and severe malnutrition: a clinical and epidemiological study in Burkina Faso. AIDS 7: 103–108.
  26. 26. Ikeogu MO, Wolf B, Mathe S (1997) Pulmonary manifestations in HIV seropositivity and malnutrition in Zimbabwe. Arch Dis Child 76: 124–128.
  27. 27. Lewinsohn DA, Gennaro ML, Scholvinck L, Lewinsohn DM (2004) Tuberculosis immunology in children: diagnostic and therapeutic challenges and opportunities. Int J Tuberc Lung Dis 8: 658–674.
  28. 28. Andreu J, Caceres J, Pallisa E, Martinez-Rodriguez M (2004) Radiological manifestations of pulmonary tuberculosis. Eur J Radiol 51: 139–149.
  29. 29. Hesseling AC, Westra AE, Werschkull H, Donald PR, Beyers N, et al. (2005) Outcome of HIV infected children with culture confirmed tuberculosis. Arch Dis Child 90: 1171–1174.
  30. 30. Kruk A, Gie RP, Schaaf HS, Marais BJ (2008) Symptom-based screening of child tuberculosis contacts: improved feasibility in resource-limited settings. Pediatrics 121: e1646–e1652.
  31. 31. Zar HJ, Cotton MF, Strauss S, Karpakis J, Hussey G, et al. (2007) Effect of isoniazid prophylaxis on mortality and incidence of tuberculosis in children with HIV: randomised controlled trial. BMJ 334: 136.
  32. 32. Violari A, Cotton MF, Gibb DM, Babiker AG, Steyn J, Madhi SA, Jean-Philippe P, McIntyre JA, CHER Study Team.Collaborators (2008) Early antiretroviral therapy and mortality among HIV-infected infants. N Engl J Med 359(21): 2233–44.