Comparison of a Clinical Prediction Rule and a LAM Antigen-Detection Assay for the Rapid Diagnosis of TBM in a High HIV Prevalence Setting

Background/Objective The diagnosis of tuberculous meningitis (TBM) in resource poor TB endemic environments is challenging. The accuracy of current tools for the rapid diagnosis of TBM is suboptimal. We sought to develop a clinical-prediction rule for the diagnosis of TBM in a high HIV prevalence setting, and to compare performance outcomes to conventional diagnostic modalities and a novel lipoarabinomannan (LAM) antigen detection test (Clearview-TB®) using cerebrospinal fluid (CSF). Methods Patients with suspected TBM were classified as definite-TBM (CSF culture or PCR positive), probable-TBM and non-TBM. Results Of the 150 patients, 84% were HIV-infected (median [IQR] CD4 count = 132 [54; 241] cells/µl). There were 39, 55 and 54 patients in the definite, probable and non-TBM groups, respectively. The LAM sensitivity and specificity (95%CI) was 31% (17;48) and 94% (85;99), respectively (cut-point ≥0.18). By contrast, smear-microscopy was 100% specific but detected none of the definite-TBM cases. LAM positivity was associated with HIV co-infection and low CD4 T cell count (CD4<200 vs. >200 cells/µl; p = 0.03). The sensitivity and specificity in those with a CD4<100 cells/µl was 50% (27;73) and 95% (74;99), respectively. A clinical-prediction rule ≥6 derived from multivariate analysis had a sensitivity and specificity (95%CI) of 47% (31;64) and 98% (90;100), respectively. When LAM was combined with the clinical-prediction-rule, the sensitivity increased significantly (p<0.001) to 63% (47;68) and specificity remained high at 93% (82;98). Conclusions Despite its modest sensitivity the LAM ELISA is an accurate rapid rule-in test for TBM that has incremental value over smear-microscopy. The rule-in value of LAM can be further increased by combination with a clinical-prediction rule, thus enhancing the rapid diagnosis of TBM in HIV-infected persons with advanced immunosuppression.


Introduction
Although the tuberculosis (TB) epidemic has plateaued in several regions of the world, in Africa, fuelled by poverty and HIV co-infection, TB is out of control. South Africa has the fifth highest burden of TB and the largest number of HIV-infected residents in any one country worldwide [1]. Given the high rate of HIV-TB co-infection, extra-pulmonary TB (EPTB) and hence central nervous system TB, which comprises 1 to 18% of EPTB [2,3,4,5], is a common clinical problem.
HIV-infected patients with TB meningitis (TBM) are particularly challenging to manage because there are no accurate tools to rapidly establish a diagnosis and delay in establishing treatment is associated with mortality [6,7,8]. Smear-microscopy in an ideal research setting, and using high volumes of processed CSF, may have a modest sensitivity [8,9]. However, in a programmatic setting in Africa the yield is dismal and recent studies in HIVinfected populations reveal a sensitivity of less than 5% [10]. Polymerase chain reaction (PCR), which may be used as a confirmatory test for TBM [11], is a good rapid rule-in test for TBM with a sensitivity of ,40 to 50% but this technology is unavailable in most hospitals in Africa [12]. We recently showed that CSF antigen-specific quantitative T cell assays may be a rapid and accurate rule-in test for TBM but the available ELISPOT assay (T SPOT TB) is expensive and requires overnight processing [13]. The initial promise of antibody [8,14,15] and antigen-based [16,17,18] tests for TBM have not been sustained. Given the poor performance of diagnostic tools we attempted to devise a clinical prediction rule, hitherto unavailable, suited to resource-poor high HIV prevalence settings.
Very recently a standardised lipoarabinomannan (LAM) antigendetection ELISA test, which yields a result within 2 to 3 hours, has been developed (ClearviewH TB ELISA, ME, USA; see http:// www.clearview.com/tb_elisa.aspx) and is useful for the diagnosis of TB in HIV-infected persons with advanced immunosuppression [19,20,21]. Although tested mainly in urine [22,23,24,25,26], we recently evaluated this assay in a proof-of-concept study using CSF from patients with suspected TBM [27]. Given the promising results in CSF [27] we performed a prospective study using the LAM Clearview TBH ELISA test in a predominantly HIV-infected population. To our knowledge there are no previous reports evaluating this assay in CSF. A particularly interesting feature of this technology, which highlights the broader significance of this work, is that a point-of-care (POC) lateral flow assay has been developed and is currently being evaluated in clinical trials [21].

Patient recruitment and processing
One hundred and fifty consecutive patients were prospectively recruited over a period of 15 months, between January 2008 and April 2009, at Inkosi Albert Luthuli Central Hospital (IALCH), a tertiary referral center in Durban, South Africa. This study was approved by the biomedical research ethics committee of the University of KwaZulu-Natal. Patients presenting with a meningeal illness indicating the need for a lumbar puncture (LP) were recruited from referring regional hospitals. Detailed recruitment and patient processing methods were recently described [28]. Informed written consent was obtained from all patients (in patients who were unable provide consent at initial presentation, due to an abnormal mental state, consent was obtained from a first degree relative or from the Head of Department when a lumbar puncture was clinically justified) [29]. After excluding contraindications to a lumbar puncture (LP), CSF samples were processed for microscopy (auramine staining of centrifuged samples using a mercury vapour fluorescent microscope), Mycobacterium tuberculosis (M.tb), bacterial, and fungal culture, and tests were performed to exclude other locally prevalent causes of meningitis including microscopy (Gram stain and for acid-fast bacilli), routine chemistry (protein, glucose, chloride), TB PCR (Roche Amplicor, Roche Diagnostics GmbH, Roche Applied Science, 68298 Mannheim, Germany), viral PCR (Roche Amplicor) for [cytomegalovirus (CMV), herpes simplex (HSV type 1) and varicella zoster virus (VZV)], fluorescent treponemal antibody (FTA) test and venereal disease research laboratory (VDRL) for neurosyphilis if FTA was positive, cysticercal enzyme linked immunosorbent assay (ELISA), and a cryptococcal antigen latex agglutination test (CLAT) which has a high specificity and sensitivity. Detailed methods were described in a previous publication [28]. Blood for CD4 counts was taken and HIV status noted in all patients. Clinical information recorded included demographic information, duration of symptoms and anti-tuberculous therapy, HIV status, duration of steroid therapy, past history of tuberculosis and history of tuberculosis (TB) contact.

Categorisation of patients
Patients were categorised as definite TBM (either CSF culture or PCR positive for M.tb) [11], probable TBM (clinical features of meningitis, an LP consistent with an aseptic bacterial meningitis, negative for other causes of meningitis, and two of the following: a chest X-ray consistent with active PTB, a CT scan consistent with TBM (basal enhancement or hydrocephalus), and a response to anti-tuberculous therapy), or non TBM (an alternate definite cause for meningitis identified and response to appropriate nontuberculous therapy) [11,30]. The reference standard was thus PCR or culture positivity for M. tb [11].
The laboratory technician was blinded to the clinical diagnosis and clinician blinded to the laboratory result. Tests were done in duplicate. Standard curves were derived by serial dilution of LAM antigen using CSF from a patient with benign intracranial hypertension.

Laboratory processing
CSF samples were processed for the detection of M.tb using a standardized PCR assay (Roche AMPLICOR) as per manufacturer instructions. LAM antigen was measured using an ELISA kit (ClearviewH TB ELISA, Inverness Medical Innovations, USA). The samples were thawed and allowed to equilibrate to room temperature. After an initial heating step (95-100uC for 30 min) to separate antigen-antibody complexes, CSF samples (0.2 mls) were seeded, in duplicate, into 96 well plates coated with anti-LAM antibodies. Following this an ELISA was done to measure optical density (OD) determined by a trained technician blinded to patient details. The LAM OD values were extrapolated from a standard curve constructed from two-fold serial dilutions (8 in total ranging from 10 to 0.08 mg/ml) of the LAM antigen (20 mg/ml) in CSF (Inverness Medical Innovations, USA).

Statistical Analysis
Chi square tests or Fisher exact tests were used to compare categorical variables between TBM and non TBM patients. Numeric variables were compared using a t-test or Wilcoxin Rank sum test/or Kruskal Wallis test if normality could not be assumed. Diagnostic performance, including 95% confidence intervals was assessed using sensitivity, specificity, agreement (proportion in whom both sample-specific results were concordant), predictive values and area under the receiver operating characteristic (ROC) curve where the combined results of culture or PCR was used as the gold standard to classify patients as definite TBM or non TBM. Three cut-off points were used: the laboratory standard, Youden index [31] and maximum specificity.
A clinical index was generated using a stepwise logistic regression model. Continuous variables such as clinical and laboratory parameters were dichotomised using ROC curves to identify cut-off points which maximised specificity prior to inclusion in the model. Rounded b-coefficients from the reduced model of significant variables were used to create a weighted clinical index. The index was then dichotomised and the sensitivity and specificity calculated. The sensitivity and specificity were recalculated using the revised clinical plus LAM index. A one sample z statistic was used to determine if adding LAM to the clinical index resulted in a significant change in diagnostic performance.

Patient characteristics
Of the 150 consecutively recruited patients, two patients were excluded (in 1 patient no definite diagnosis made and in one other no CSF obtained). Thus, 148 samples were processed for LAM antigen ( There were 14 PCR positive samples within the cohort of 31 culture positive patients. 84% of the cohort was HIV-infected, 13.5% HIV uninfected, 5% declined HIV testing. The median inter-quartile range (IQR) CD4 count was 132 cells/ml (54;241). Socio-demographic and a comparison of CSF findings between definite TBM and non-TBM groups findings are shown in Table 1. Alternate diagnoses in the non TBM group included cryptococcal meningitis (n = 30), bacterial meningitis (n = 5), viral meningitis (n = 14; 4 VZV, 1 CMV, 9 unknown), neoplastic meningitis (n = 2), mucormycosis (n = 1), venous sinus thrombosis with CSF change (n = 1), and neurosyphilis (n = 1)

LAM antigen detection test outcomes
Performance outcomes were derived using the manufacturer's recommended cut-point (OD value of 0.1295), an optimal cutpoint using Youden's index (a point on the ROC curve yielding maximal sensitivity matched with the corresponding specificity) and the AUC-derived cut point selecting for high specificity at the expense of sensitivity. Outcomes are shown when the definite TBM group (n = 39) was compared to: (i) the entire non TBM group; i.e. including patients with cryptococcal, acute bacterial and other causes mentioned above (n = 54; Table 2A), (ii) non-TBM patients who were Gram stain or CLAT positive (n = 35; Table 2B), and (iii) non-TBM patients who were Gram stain or CLAT negative (n = 19; Table 2C). Thus, to evaluate whether other simultaneously used rapid tests impacted on test findings, we determined results for 3 different cut points in each of the categories specified. We selected a cut-point of $0.18 because a high specificity and moderate sensitivity defined a clinically useful rule-in test; Table 2. Figure 2 illustrates the comparison between definite and non TBM groups (unselected) and when the non TBM group was split into CLAT and Gram stain positive samples, and CLAT and Gram stain negative with the corresponding ROC curves.
There were 19 patients in the non-TBM group in whom the LAM antigen was positive using the OD value of 0.1295 as the cut-point. Of this group 14 patients had cryptococcal meningitis and 5 patients had viral meningitis. Given that patients were transferred out to referring hospitals upon improvement no comprehensive follow-up information was available for these patients. Twelve patients in the definite TBM group were negative for LAM antigen detection.

Relationship to CD4 count
When patients were stratified according to CD4 count, there was a greater likelihood of definite TBM when the CD4 count was ,100 cells/ml versus $100 cells/ml; p = 0.01; Table 3. A comparison of CD4 counts ,200 to $200 cells/ml also showed significance; p = 0.03. No significant difference was seen when sensitivity was compared in the in the HIV-infected and HIV uninfected groups (p = 0.3; Table 3). However, there were very few patients in the HIV negative group.
There was no distinction when comparing probable TBM and non TBM groups when stratified according to a CD4 count ,100 cells/ml versus $100 cells/ml; p = 0.4.

Derivation of a clinical prediction rule and comparison to CSF LAM levels
We derived a clinical index using univariate and multivariate analysis (shown in Table 4). Factors significantly associated with a diagnosis of TBM in the multivariate analysis were CSF to serum glucose ratio, lymphocyte count, CD4 count and a negative CLAT result. The clinical prediction rule was then calculated using the formula based on the coefficients from the multivariate model and examined using various cut-points for the diagnosis of TBM. The cut-point of $6 provided the best rule-in value. Table 5 shows outcome data using the clinical prediction rule alone and when the clinical prediction rule was combined with the LAM result: there was a significant improvement in sensitivity (31% to 63%; p = ,0.001) and agreement (68% to 80% (p = 0.01) but specificity remained high at 93%.

Comparison of rapid tests for the diagnosis of TBM
Three tests were applied for a rapid diagnosis. When examining for yield for rapid diagnosis using only culture positive patients as the denominator (n = 31 of the 39 definite TBM patients) the yields for smear microscopy, LAM and PCR were, 0 (0%), 9 (29%, at cut-point $0.18) and 14 (45%), respectively. Thus, there was a significantly improved yield over smear microscopy when using both LAM (p,0.001) and PCR (p = ,0.001). There was no significant difference between the LAM and PCR yield (p = 0.22).

Discussion
This study has three major findings. Firstly a newly developed clinical prediction rule, suited to resource-poor high HIV prevalence settings, is a useful rule-in test for the rapid diagnosis of TBM. Secondly, LAM antigen, which has not previously been prospectively evaluated in CSF, is useful as a rapid rule-in test for the diagnosis of TBM in HIV-infected individuals with advanced immunosuppression. Thirdly, combining the prediction rule with LAM antigen detection further increases the rule-in value for TBM. Given that standardised PCR assays have modest sensitivity [12], are expensive, and not widely available in high TB and HIV burden settings, smear microscopy remains the only diagnostic test that can rapidly and confidently establish a diagnosis of TBM. Thus, although at first glance, the LAM sensitivity of 31% may seem modest the high specificity confers rule-in value enabling a rapid diagnosis in approximately a third more of patients than could have been obtained with microscopy. Furthermore, in HIVinfected persons with a CD4 count of less than 100 cells/ml the sensitivity rose to 50%. Several studies have now confirmed the rule-in utility of the LAM ELISA in HIV co-infected subjects with advanced immunosuppresion when using urine samples [19,21,24,25,32,33]. These studies have also confirmed that urine LAM positivity is associated for HIV positivity and advanced immunosuppresssion characterised by low CD4 counts [19,24,32]. Similarly, we confirm that in CSF LAM positivity is associated with a positive HIV status and low CD4 count. We hypothesise that HIV-infected patients, particularly those with advanced immunosuppression, have a higher mycobacterial load and hence higher levels on LAM antigen in body fluids [24].
These results are of considerable significance given that a POC lateral flow format of the LAM assay is now at a finalised prototype stage and available for clinical trials [21]. This POC format now requires optimisation using CSF given that the assay was designed for use with urine samples.
A clinical prediction rule using laboratory parameters widely available in resource-poor high HIV prevalence settings had rulein value similar to that of the LAM assay. An existing clinical prediction rule has been developed by Thwaites and colleagues but was tailored to diagnose bacterial rather than TB meningitis [9]. Similarly, two other studies in resource-poor settings identified a week long history, CSF cell count of ,1000 cells/mm 3 , predominant lymphocytosis, and focal deficits as predictive for TBM [34,35]. These studies sought to distinguish bacterial and TBM, rather than distinguishing between causes of aseptic meningitides. More recently, case definitions for TBM in high burden settings have been proposed [36]. We applied these definitions to our probable TB group. This categorised patients as probable TBM (64%; based on the proposed definition as outlined in [36]) and as possible TBM (35%; based on the proposed definition as outlined in [36]). When our scoring system was combined with the LAM assay the rule-in value significantly improved to ,65%. Thus, if the POC version of the LAM assay is combined with the prediction rule then this could likely enable the rapid diagnosis of definite TBM in more than two thirds of HIV co-infected patients in an African setting. Preliminary data suggest that the POC LAM assay has equivalent sensitivity to the ELISA version when using urine samples [21]. The assay now requires testing in CSF.
Albeit below our ROC-derived cut-point of 0.18 LAM antigen was nevertheless detected in 19 patients in the non-TBM group (14 cryptococcal meningitis and 5 viral meningitides). Seven patients in this group had culture proven dual infection, i.e. tuberculous and cryptococcal meningitis, which is well documented in HIV-infected patients [37]. In the remaining 12 patients the possibility of concomitant TB infection cannot be excluded with certainty and thus misclassification bias may explain the detection of LAM antigen, at least, in some of these patients. Although comprehensive follow-up was not available, these patients were observed as in-patients for a period of 7 to 10 days for Table 2. Performance outcomes (sensitivity, specificity, predictive values and accuracy) of the LAM ELISA (95% CI), at different cutpoints in the definite TBM and non-TBM groups, using CSF.  (2A) compares the definite TB meningitis (n = 39) and unselected non-TB meningitis (n = 54) groups. To evaluate whether other concomitantly used rapid tests could enhance the specificity of the LAM assay the data were also analysed when the non-TB groups were divided into those who had a positive Gram stain or CLAT (2B), or those non-TBM patients who had a negative Gram stain or CLAT (2C). Each of the tables (2A, 2B, 2C) has results specified using the manufacturer's cut-point, optimal cut point using Youdens index and an AUC derived cut point. *Values expressed as percentages using manufacturers cut point for urine.

{
Optimal cut-point as defined by Youden's index [31].  improvement before discharge back to their referring hospitals. We believe that misclassification bias is unlikely to fully explain our observations as the same cohort segregated well when the CSF samples were applied to the antigen-specific ELISPOT test [28]. An alternative explanation might be cross-reactivity with cryptoccocal antigen. Indeed, mannan residues are found in the crytococcal cell wall [38]. However this possible explanation is unlikely as there was no change in specificity when cryptococcal meningitis was excluded from the comparison between definite and non-TBM groups. Thus, the most likely explanation is cross reactivity to another antigen, possibly a host-derived lipid antigen, which is found in high concentrations in the lipid-containing central nervous system tissue. The sensitivity and specificity is different in non-lipid containing biological fluids remote from the site of infection such as urine. The 12 false negative LAM test results in the definite TBM group are more difficult to explain. Possibilities include, given the paucibacillary disease, a low concentration of LAM antigen in the CSF, which was below the detection limit of the assay, and the sequestration of LAM antigen in immune complexes despite the heating step designed to separate LAM-antibody complexes [39].
Previous studies have documented yields of ,60% for smear microscopy of the CSF after careful examination for 30 minutes and using high volume processed samples [40]. By contrast, our study similar to others, performed in a programmatic setting [6,10,40,41,42,43,44,45,46] detected virtually no positive samples by smear-microscopy. The high workload (300 microscopy slides per day) by a single technician with brief microscopic examination of small volumes of CSF in a 'real world' setting prevents reproduction of yields seen in a research setting [40]. Thus, our study highlights the difficulty of making a diagnosis of TBM in a high HIV prevalence setting and the need for new diagnostic tools. Although lymphocytosis predominates in 85% of patients [6,7,9,10,35,45,47,48,49,50] a neutrophil predominance may be seen in the first 10 days [51] (even in HIV co-infected patients [50,52]), the CSF may be acellular, and the protein levels normal [47]. Thus a variable picture leaves one uncertain when faced with a patient requiring empirical therapy.
The limitations of this study are the small sample size and inadequate follow up of patients to better characterise patients in terms of diagnosis. However, this study is relatively large compared to others evaluating diagnostic tools for TBM. Furthermore, our results are only generalisable to African populations with a high HIV prevalence, and these results remain to be confirmed in different geographical settings. Finally, it should be borne in mind that this commercial assay is optimised for use using urine samples and its use here represents an off-label indication. Further studies are now required using an ELISA and lateral flow assay optimised using CSF samples.
In summary, this study suggests that a standardised LAM antigen detection assay is a useful rapid rule-in test for TBM in HIV-infected individuals with advanced immunosuppression. The test's rule-in value can be enhanced by combining it with a clinical prediction rule developed for patients with suspected TBM from a high TB and HIV prevalence setting. Studies are now required to confirm these findings in other settings, to ascertain the value of combining LAM with alternative rapid tests such as quantitative T cell assays [28], and to clarify the utility of using a lateral flow point-of-care LAM assay optimised for use with CSF.