Studies in the past have shown that perforin expression is up-regulated during acute renal rejection, which provided hopes for a non-invasive and reliable diagnostic method to identify acute rejection. However, a systematic assessment of the value of perforin as a diagnostic marker of acute renal rejection has not been performed. We conducted this meta-analysis to document the diagnostic performance of perforin mRNA detection and to identify potential variables that may affect the performance.
Relevant materials that reported the diagnostic performance of perforin mRNA detection in acute renal rejection patients were extracted from electronic databases. After careful evaluation of the studies included in this analysis, the numbers of true positive, true negative, false positive and false negative cases of acute renal rejection identified by perforin mRNA detection were gathered from each data set. The publication year, sample origin, mRNA quantification method and housekeeping gene were also extracted as potential confounding variables. Fourteen studies with a total of 501 renal transplant subjects were included in this meta-analysis. The overall performance of perforin mRNA detection was: pooled sensitivity, 0.83 (95% confidence interval: 0.78 to 0.88); pooled specificity, 0.86 (95% confidence interval: 0.82 to 0.90); diagnostic odds ratio, 28.79 (95% confidence interval: 16.26 to 50.97); and area under the summary receiver operating characteristic curves value, 0.9107±0.0174. The univariate analysis of potential variables showed some changes in the diagnostic performance, but none of the differences reached statistical significance.
Despite inter-study variability, the test performance of perforin mRNA detected by polymerase chain reaction was consistent under circumstances of methodological changes and demonstrated both sensitivity and specificity in detecting acute renal rejection. These results suggest a great diagnostic potential for perforin mRNA detection as a reliable marker of acute rejection in renal allograft recipients.
Citation: Shang Y, Ju W, Kong Y, Schroder PM, Liang W, Ling X, et al. (2012) Performance of Polymerase Chain Reaction Techniques Detecting Perforin in the Diagnosis of Acute Renal Rejection: A Meta-Analysis. PLoS ONE 7(6): e39610. https://doi.org/10.1371/journal.pone.0039610
Editor: Gayle E. Woloschak, Northwestern University Feinberg School of Medicine, United States of America
Received: April 14, 2012; Accepted: May 23, 2012; Published: June 29, 2012
Copyright: © 2012 Shang et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was supported by the National High Technology Research and Development Program of China (863 Program) (2012AA021008), the Key Clinical Project from the Ministry of Health (2010159), the National Natural Science Foundation of China (30972951, 81102244, 81102245, and 81170448), the Special Fund for science research by Ministry of Health (201002004), the Research Fund for the Doctoral Program of Higher Education of China by Ministry of Education (20100171110063 and 20110171120077), the Science and Technology Planning Key Clinical Project of Guangdong Province (2011A030400005), and Project by Division of Medical Service Management of Ministry of Health(2010). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Renal transplantation has been the treatment of choice for patients with end-stage renal disease (ESRD) for decades. However, although novel and powerful immunosuppressive drugs have been developed, acute rejection (AR) remains a major cause of allograft dysfunction and allograft failure , . Even a single episode of AR can be a strong predictor of graft failure .
Currently, the diagnosis of AR is established based on histological evaluation of allograft biopsy samples. However, biopsy is an invasive procedure that may cause biopsy-associated complications such as perirenal hematoma, hematuria and infection , , which restrict its application for serial surveillance testing. In addition, sampling error and the variability of the pathological changes of AR make it difficult to make definitive diagnoses based on renal biopsy in many cases . Other methods such as ultrasonography and serum creatinine measurements can be indicative of ARbut cannot reach a conclusive diagnosis , . Therefore, developing a reliable, specific and non-invasive diagnostic method for identifying ARwould be of great help to improve clinical practice in renal transplantation.
Since allograft infiltration by T lymphocytes is a distinctive feature of rejection, analyzing the expression of specific genes involved in T cell activation provides a new option for AR diagnosis. Among the numerous cell subsets that infiltrate the graft site, cytotoxic T lymphocytes (CTL) are one of the major effector cells during the AR response. Lipman et al.  and Suthanthiran et al.  revealed a significant increase in transcription of the gene encoding perforin, one of the predominant effector molecules of CTLs , in allograft biopsy samples from AR patients using polymerase chain reaction (PCR) techniques. Since that time, many studies had been conducted to validate this approach for AR diagnosis in the clinic, and the samples collected for analysis have been expanded from allograft biopsy samples to less invasive peripheral blood leukocytes (PBL) and urine samples.
Although increased levels of perforin mRNA were a common finding during AR in a series of studies –, controversy still exists regarding the clinical utility of this test due to the single study design of the previous work and the variable laboratory methodology used to perform the test among the different studies. Herein, we performed a meta-analysis to document the diagnostic performance of perforin mRNA detection in the identification of AR and try to determine its clinical utility by seeking the potential variables that may affect the performance of this test. These data provide important insights that inform clinical physicians regarding the diagnosis of AR in renal transplantation.
Materials and Methods
This analysis was conducted in accordance with a predetermined protocol following the recommendations of Deeks et al. . The data collection and reporting were in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement (Table S1).
Relevant materials in the scientific literature were searched in electronic databases including MEDLINE, EMBASE and the Cochrane Database of Systematic Reviews prior to December 1st, 2011, without date or language limitations. The following combinations of key words were used to search for related studies: “perforin” AND (“renal transplant” OR “renal transplantation” OR “kidney transplant” OR “kidney transplantation”) AND “rejection.” The electronic searching was supplemented by checking reference lists from the identified articles for additional original reports.
Inclusion and Exclusion Criteria
Studies were included if they fulfilled the following criteria: (1) Two comparison groups of patients were necessary for every study: AR group and non-rejection group. (2) Patient samples were diagnosed as AR or non-rejection based on the histological evidence according to Banff classification. (3) Quantitative detection of perforin mRNA expression level was accomplished by PCR techniques. (4) The mRNA detection was conducted either at the same time as biopsy pathological evaluation or immediately after with the samples being frozen for preservation during the evaluation. (5) The expression level of perforin was compared to the chosen housekeeping genes which were expressed at a constant level in samples from different patient groups. (6) A specific cutoff value was set to interpret the perforin mRNA results as positive or negative for AR (for those studies which defined the results as “detectable” or “undetectable,” “detectable” results were regarded as positive and vice versa).
The following types of studies were excluded from this meta-analysis: (1) Works designated as conference abstracts, letters, case reports, editorials or reviews. (2) Studies only involving pediatric patients.
Assessment of Study Quality
The quality of each study’s methodology was assessed using the 14-item Quality Assessment of Diagnostic Accuracy Studies (QUADAS) list . Each question was assigned with a response of yes, no, or unclear when evaluating each of the included studies. Since the assessment of quality related strongly to the reporting of results, a well conducted study could score poorly if the methods and results were not reported in sufficient detail. Therefore, we did not report the assessment in scores but in descriptive forms only.
Publication bias was tested using funnel plots and the Egger test by Stata statistical software (STATA) version 11.0 . An asymmetric distribution of data points in the funnel plot and a quantified result of P<0.05 in the Egger test indicated the presence of potential publication bias .
The following data were extracted from each eligible study: year of publication, sample origin, mRNA quantification method, housekeeping gene, and the number of true positive (TP), false positive (FP), false negative (FN) and true negative (TN) cases of AR identified by perforin mRNA levels. All subjects who displayed biopsy results with any degree of AR defined by Banff classification were assigned to the rejection group, regardless of cellular or humoral rejection. The subjects with biopsies showing no evidence of any types of rejection, including normal tissues and tissues with non-rejection pathological changes, were assigned to the non-rejection group. The selected articles were assessed by two reviewers (YS and XL), independently. Disagreements were resolved by consultation with a third reviewer (ZG).
Data were analyzed using Meta-Disc Version 1.4  and STATA version 11.0. The test performance of perforin mRNA detection for the identification of ARwas measured by the following indicators: sensitivity, specificity and diagnostic odds ratio (DOR). Sensitivity was represented by the proportion of AR cases that were correctly identified by the positive results of perforin mRNA levels. Specificity was represented by the proportion of non-rejection cases that were correctly identified by the negative results of perforin mRNA levels . As different cutoff values were used in each study, there was the potential for a threshold effect which would affect the conclusions of this analysis. Therefore, it was more reliable to define the summary of test performance using DOR than simply pooling sensitivity and specificity together across the studies. DOR was an independent indicator ranging from 0 to infinity, which represented how much greater the odds of having AR were for patient with a positive perforin mRNA result than for patient with a negative perforin mRNA result. The higher the DOR, the better the discriminatory ability of the test was .
The summary receiver operating characteristic (SROC) curve was plotted based on the combination of sensitivity and specificity, and the area under the curve (AUC) value was then calculated as a global measurement of test performance. The closer the AUC was to 1, the better the test performance .
Because of potential heterogeneity between studies, effect sizes were pooled by random-effects models of DerSimonian and Laird in Meta Disc . Empty cells were handled using a 0.5 continuity correction.
The χ2 test was used to examine heterogeneity in pooling sensitivity and specificity. The Cochran Q test was used to examine heterogeneity in pooling DOR. Heterogeneity was considered to be statistically significant when P<0.05 in these qualitative tests. We also conducted the I2 test in every pooling analysis to quantitatively estimate the proportion of total variation across studies that was attributable to heterogeneity rather than chance. The I2 value would range from 0 to 100%, with a value over 50% indicating significant heterogeneity.
The existence of a threshold effect would manifest as a curvilinear shape in the SROC curves. In addition, we used a Spearman correlation analysis to confirm the absence or presence of a threshold effect by looking for an inverse relationship between sensitivity and specificity. A value of P<0.05 would indicate a significant threshold effect was present .
To determine whether any single study was incurring undue weight in the analysis, we systematically removed one set of study data and checked the pooled results for the remaining studies to see if they changed significantly. The sensitivity analysis was conducted for every study.
To identify the sources of potential heterogeneity that influenced the results of this analysis, a univariate analysis was conducted. Based on the literature review, the following factors were chosen as potential variables that may have influenced the test performance: year of publication, sample type, mRNA quantification method and housekeeping gene selection. Data sets were stratified based on these factors and the test performance would be compared between subgroups using the DOR values and the AUC of the SROC curves as the major parameters. The comparison was conducted using random-effects models in STATA. A value of P<0.05 in the comparison of DOR indicated a significant change in the test performance due to the covariate.
Literature Search and Characteristics of the Included Studies
After the primary search of the electronic databases for published work on the subject, 202 studies were identified. Of these studies, 123 were excluded after further review of the title and abstract for irrelevant topics, and an additional 19 were excluded for duplication of the reports, which left 60 studies undergoing full text review. The detailed process of this literature search is shown in Figure 1.
After careful review, 14 studies with a total of 501 subjects were included in this meta-analysis. In 2 studies , , perforin expression was detected in both graft biopsy and PBL samples. In another study , perforin expression was detected in both PBL and urine samples. We decided to retrieve each group as an independent data set for a total of 17 data sets included in this analysis. The characteristics of each included study are shown in Table 1.
We used the QUADAS list of questions to review the test quality of the included studies. Most of the studies satisfied a majority of the items on the QUADAS list. The most common missing items in the studies included in this analysis were reports of intermediate results and withdrawn cases. In addition, some of the studies failed to mention the blinded interpretations between the PCR results and the histological evaluation (Table S2).
The Egger test revealed the possibility of significant publication bias among the included reports (P = 0.008). The funnel plot in Figure S1 also presented a certain degree of asymmetry, indicating the potential for publication bias among the studies included in this analysis.
Overall Diagnostic Performance of Perforin Expression
Figure 2 shows the overall diagnostic measurements of perforin expression in detecting AR. The summary sensitivity was 0.83 [95% confidence interval (CI): 0.78 to 0.88], with individual sensitivities ranging from 0.50 to 1.00. The summary specificity was 0.86 (95% CI: 0.82 to 0.90), with individual specificities ranging from 0.50 to 1.00. Both pooled estimations showed significant heterogeneity (Sensitivity: P = 0.0041, χ2 = 34.92, I2 = 54.2%; specificity: P = 0.022, χ2 = 29.35, I2 = 45.5%).
(A) Pooled sensitivity. (B) Pooled specificity. Effect sizes were pooled by random-effects models. The point estimates from each study are shown as solid squares. The pooled estimates are shown as a solid diamond. Error bars represent 95% CIs.
The pooled DOR and the SROC curves based on summary sensitivity and specificity across all data sets are shown in Figure 3. The pooled DOR was 28.79 (95% CI: 16.26 to 50.97), with individual DORs ranging from 4.67 to 241.44. The results of DOR showed consistency accross the included reports, without noticeable heterogeneity (P = 0.74, Cochran-Q = 12.05, I2 = 0.0%). The point size in the SROC curve represented the proportional study weight. Most data gathered near the top left corner where sensitivity and specificity were both the highest. The AUC value was 0.9107±0.0174.
(A) Overall DOR. (B) The SROC curves for all data sets. Effect sizes were pooled by random-effects models. The pooled DOR is shown as a solid diamond. Each square in the SROC curve represents one study. Sample size is indicated by the size of the square.
Although we did not notice a curvilinear shape distribution of the data in the SROC curve, the Spearman correlation analysis revealed a significant result (P = 0.032), suggesting the potential presence of a threshold effect.
We systematically removed one data set at a time and recalculated the DOR and AUC values for the remaining studies. The largest change occurred when removing the data set from Sabek et al. , which changed the pooled DOR from 28.79 to 35.68 (+23.9%), and the corresponding change in AUC value was from 0.9107 to 0.9228 (+1.33%). The second largest change occurred when removing the urine subgroup from Dias et al. , which changed the pooled DOR from 28.79 to 26.54 (−7.81%) and the corresponding AUC value from 0.9107 to 0.9058 (−0.54%). These results indicated that no single data set carried enough weight to significantly influence the pooled test performance reported for the ability of perforin mRNA detection to identify cases of acute renal rejection.
Based on the year of publication of the studies included in this analysis, we divided the data sets into two subgroups: those reported prior to the year 2000 and those reported after the year 2000 (including studies published in 2000). This time point was chosen because significant progress was made in the PCR technology and experimental methodology at the beginning of the 21st century, which may have had an effect on the perforin mRNA detection performance. We noticed a remarkable difference in the amount of publications in each subgroup. Only 4 reports were published prior to 2000 , , , , one of them contained 2 data sets which made it 5 data sets in this subgroup. The remaining 10 reports (12 data sets) were published after 2000 , , , –. The DOR of studies before the year 2000 was 43.52 while the DOR of studies after 2000 was 24.90. The difference was not statistically significant (P = 0.59).
The studies were stratified according to the 3 types of samples: allograft biopsy tissue, PBL and urine. The biopsy subgroup contained 6 data sets , , , , , , the PBL subgroup contained 7 data sets –, , –, and the urine subgroup contained 4 data sets , –. The DORs were 35.11, 21.32, 36.76 for biopsy group, PBL group and urine group, respectively. However, the difference in DORs did not reach a level of statistical significance (P = 0.77).
Messenger RNA quantification method.
There were 3 different PCR techniques used in the included studies to quantify perforin mRNA: 8 data sets used reverse transcriptase PCR (RT-PCR) , , , , , , 6 data sets used competitive RT-PCR , , , , , and 3 data sets used real-time quantitative RT-PCR , , . The DOR was 25.23 for RT-PCR, 37.94 for competitive RT-PCR and 33.35 for real-time quantitative RT-PCR. The difference between the three techniques was not statistically significant (P = 0.89).
Four different housekeeping genes were used as the standard expression in the included studies to measure the relative expression level of perforin: cyclophilin for 4 data sets , –, β-actin for 5 , , , , 18s rRNA for 2 , , and glyceraldehyde-3-phosphate dehydrogenase (GAPDH) for 6 , , , , . The DOR was 36.76 for cyclophilin group, 34.38 for β-actin group, 12.03 for 18s rRNA group and 33.45 for GAPDH group. However, the result was not statistically significant either (P = 0.95).
Table 2 summarizes the results of univariate analysis.
Since the middle of the 20th century, great success has been made in renal transplantation with the progress in surgical techniques, expanded organ sources, organ preservation techniques, novel immunosuppressants and management of complications. However, transplant patients are still facing many challenges, among which AR draws the greatest attention. Despite the fact that histological evaluation for AR has been well defined in guidelines such as Banff criteria  and Cooperative Clinical Trials in Transplantation (CCTT) criteria , novel and less invasive methods are still required to improve the diagnostic evaluation of AR. The effector molecules of CTLs such as perforin, granzyme B, Fas and Fas ligand are potential diagnostic markers for AR, especially when they can be detected in samples such as PBLs and urine that do not require invasive procedures to obtain. The major objectives of conducting this meta-analysis were to explore the diagnostic performance of perforin mRNA expression in AR and to determine its clinical utility. To our knowledge, this is the first pooled estimation of the diagnostic performance of perforin mRNA detection for the evaluation of AR in renal transplant recipients.
In this meta-analysis, we included 14 relevant studies with a total of 501 subjects. Although results were not consistent across the different studies, the overall diagnostic performance of detecting perforin mRNA in kidney transplant patients showed pooled sensitivity and specificity of 0.83 (95% CI: 0.78 to 0.88) and 0.86 (95% CI: 0.82 to 0.90), respectively. The pooled DOR and AUC of the SROC curves for all data sets were 28.79 (95% CI: 16.26 to 50.97) and 0.9107±0.0174, respectively. These results represented a good diagnostic efficacy for perforin mRNA detection in identifying AR, regardless of the sample origin and methodology variation. Furthermore, to investigate potential variables that might have influenced the diagnostic performance, we conducted a univariate analysis trying to provide clues for methodology standardization. In this analysis, none of the chosen factors appeared to have a significant effect on the diagnostic performance. This lack of variation from the chosen factors may be due to the small sample sizes of the included data sets since this diagnostic method had not been widely used in transplant centers. In addition, the perforin gene sequences used in the included reports were not uniform, which could be another potentail source of variation that may have influenced test performance. However, the limited number of data sets using each perforin sequence restricted us from categorizing the studies into subgroups for the univariate analysis.
In several clinical studies during the 1990s , , , cytotoxic gene expression was found to be up-regulated in allografts during AR. However, these discoveries had limited impact as diagnostic tests that supplemented the histological diagnosis of AR at that time. More recently, given the fact that lymphocytes would infiltrate the kidneys during AR and present in urine sediment cells, Li et al.  explored the utilization of perforin mRNA detection in urine cells as a non-invasive diagnostic marker of AR. Subsequent studies conducted in other centers confirmed the feasibility of this approach , . Although in our analysis, the diagnostic performance of urine sample didn’t stand out particularly, the result was still encouraging since it brought hope for a non-invasive method for the diagnosis of AR which was as reliable as biopsy sample.
Debates about the application of urine perforin detection mainly focus on the differential diagnosis between rejection and other complications such as delayed graft function (DGF) and urinary tract infection (UTI). In the study conducted by Yannaraki et al. , an increase in perforin mRNA was found in both the AR group and the UTI group. Their experience suggested a significant overlap of perforin mRNA levels in different clinical conditions, which made it difficult to establish a threshold value for differential diagnosis. Øzbay et al.  reported similar results when trying to differentiate AR from bacteriuria. This may be explained by the similar cytolytic response of the activated T lymphocytes during both rejection and infection. In three of the 4 included studies in the urine subgroup of this meta-analysis –, the non-rejection samples were composed of stable grafts only, while in the other study , the non-rejection samples contained chronic allograft nephropathy, toxic tubulopathy, nonspecific changes, acute tubular necrosis and renal-vein thrombosis. The non-rejection controls in other included studies also contained samples with multiple other types of kidney dysfunction other than graft rejection, which did not allow us to carry out a meta-analysis of the differential diagnostic performance of perforin. Therefore, we could not conclude that a high perforin expression level would definitely point to the diagnosis of AR, which would require supplemental laboratory tests to rule out other complications.
Although urine is the ideal choice for a non-invasive procedure, there are some potential limitations to this approach. Most importantly, the test depends on urine production. This limits the utilization in patients under anuric conditions which can appear during AR, acute tubular necrosis (ATN), DGF, as well as other conditions. In the study conducted by Dias et al. , nearly 20% of the patients were unable to provide sufficient urine samples for analysis. Given these circumstances, the evaluation of perforin mRNA levels in PBLs and allografts are important alternatives. An increase in perforin mRNA can help clinical decision-making for early enhanced immunosuppression intervention before histological evidence of substantial damage develops, and a decrease in perforin mRNA levels may provide an indication of response to therapy.
There are several limitations in this meta-analysis. First, qualities of the included studies were not uniform. The essential demographical data like age and gender distributions were missing in some studies, which might be a potential heterogeneity source in the analysis. Also, the specific cut-off values for the mRNA level were not provided in most of the studies. In addition, only 14 studies met the inclusion criteria in this analysis. The small sample size limited the generalization of the results and did not allow us to test the differential diagnostic performance of perforin mRNA detection. All these limitations provide room for future evaluation.
In conclusion, the test performance of perforin mRNA detected by PCR techniques was impressive and consistent under circumstances of methodological changes. The test in urine stood out as a potential novel and non-invasive method for the reliable diagnosis of AR, or at least as an indicator that a biopsy is warranted. Prospective studies with larger sample sizes would reinforce the findings revealed in the current meta-analysis and may be able to reveal how perforin mRNA detection would help to differentiate between diagnoses that are clinically similar to AR, providing more conclusive evidence for its clinical utility in the evaluation of renal transplant recipients.
Funnel plot for the assessment of potential publication bias. The funnel graphs plot the log of the DOR against the standard error (SE) of the log of the DOR. Each solid circle represents each study in the meta-analysis. Asymmetry of the circle distribution between two sides indicates potential publication bias.
Conceived and designed the experiments: YS WJ YK ZG XH. Performed the experiments: YS WJ YK. Analyzed the data: YS WJ YK. Contributed reagents/materials/analysis tools: WL XL. Wrote the paper: YS WJ YK ZG XH. Copyedited the manuscript: PMS.
- 1. Matas AJ, Gillingham KJ, Payne WD, Najarian JS (1994) The impact of an acute rejection episode on long-term renal allograft survival (t1/2). Transplantation 57: 857–859.
- 2. Matas AJ (1998) Acute rejection is a major risk factor for chronic rejection. Transplant Proc 30: 1766–1768.
- 3. Hariharan S, Johnson CP, Bresnahan BA, Taranto SE, McIntosh MJ, et al. (2000) Improved graft survival after renal transplantation in the United States, 1988 to 1996. N Engl J Med 342: 605–612.
- 4. Huraib S, Goldberg H, Katz A, Cardella CJ, deVeber GA, et al. (1989) Percutaneous needle biopsy of the transplanted kidney: technique and complications. Am J Kidney Dis 14: 13–17.
- 5. Beckingham IJ, Nicholson ML, Bell PR (1994) Analysis of factors associated with complications following renal transplant needle core biopsy. Br J Urol 73: 13–15.
- 6. Rush D (2009) Can protocol biopsy better inform our choices in renal transplantation? Transplant Proc. 41. pp. S6–S8.
- 7. Perella RR, Duerinckx AJ, Tessler FN, Danovitch GM, Wilkinson A, et al. (1990) Evaluation of renal transplant dysfunction by duplex Doppler sonography: a prospective study and review of the literature. Am J Kidney Dis 15: 544–550.
- 8. Schold JD, Kaplan B (2010) The elephant in the room: failings of current clinical end points in kidney transplantation. Am J Transplant 10(5): 1163–1166.
- 9. Lipman ML, Stevens AC, Strom TB (1994) Heightened intragraft CTL gene expression in acutely rejecting renal allografts. J Immunol 152(10): 5120–5127.
- 10. Suthanthiran M, Manikkam MD (1997) Clinical application of molecular biology: a study of allograft rejection with polymerase chain reaction. Am J Med Sci 313(5): 264–267.
- 11. Lichtenheld MG, Olsen KJ, Lu P, Lowrey DM, Hameed A, et al. (1988) Structure and function of human perforin. Nature 335: 448–451.
- 12. Muthukumar T, Dadhania D, Ding R, Snopkowski C, Naqvi R, et al. (2005) Messenger RNA for foxp3 in the urine of renal-allograft recipients. N Engl J Med 353: 2342–51.
- 13. Nickel P, Lacha J, Ode-Hakim S, Sawitzki B, Babel N, et al. (2001) Cytotoxic effector molecule gene expression in acute renal allograft rejection: correlation with clinical outcome; histopathology and function of the allograft. Transplantation 72(6): 1158–1161.
- 14. Yannaraki M, Rebibou JM, Ducloux D, Saas P, Duperrier A, et al. (2006) Urinary cytotoxic molecular markers for a noninvasive diagnosis in acute renal transplant rejection. Transpl Int 19(9): 759–768.
- 15. Deeks J (2001) Systematic reviews of evaluations of diagnostic and screening tests. In: Egger M, Davey Smith G, Altman D, editors. London: BMJ Publishing Group.
- 16. Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J (2003) The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol 3: 25.
- 17. Stata Corporation website. Accessed: 2012 May 30.
- 18. Egger M, Davey SG, Schneider M, Minder C (1997) Bias in meta-analysis detected by a simple, graphical test. BMJ 315: 629–634.
- 19. Zamora J, Abraira V, Muriel A, Khan KS, Coomarasamy A (2006) Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol 6: 31.
- 20. Altman DG, Bland JM (1994) Diagnostic tests 1: sensitivity and specificity. BMJ 308: 1552.
- 21. Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM (2003) The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol 56: 1129–1135.
- 22. Moses LE, Shapiro D, Littenberg B (1993) Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med 12: 1293–1316.
- 23. DerSimonian R, Kacker R (2007) Random-effects model for meta-analysis of clinical trials: An update. Contemp Clin Trials 28: 105–114.
- 24. Devillé WL, Buntinx F, Bouter LM, Montori VM, de Vet HC, et al. (2002) Conducting systematic reviews of diagnostic studies: didactic guidelines. BMC Med Res Methodol 2: 9.
- 25. Netto MVP, Fonseca BAL, Dantas M, Saber LTS, Castro MCR, et al. (2002) Granzyme B, Fas-ligand and perforin expression during acute cellular rejection episodes after kidney transplantation: comparison between blood and renal aspirates. Transplant Proc 34(2): 476–478.
- 26. Vasconcellos L, Lauro M, Asher F, Schachter D, Zheng X (1998) Cytotoxic lymphocyte gene expression in peripheral blood leukocytes correlates with rejecting renal allografts. Transplantation 15 66(5): 562–566.
- 27. Dias ECA, Joelsons G, da Silva DM, Berdichewski RH, Ribeiro AR, et al. (2008) Non-invasive diagnosis of acute rejection in kidney transplants with delayed graft function. Kidney Int 73(7): 877–884.
- 28. Sabek O, Dorak MT, Kotb M, Gaber A, Gaber L (2002) Quantitative detection of t-cell activation markers by real-time PCR in renal transplant rejection and correlation with histopathologic evaluation. Transplantation 15 74(5): 701–707.
- 29. Lipman ML, Shen Y, Jeffery JR, Gough J, McKenna RM, et al. (1998) Immune-activation gene expression in clinically stable renal allograft biopsies: molecular evidence for subclinical rejection. Transplantation 27 66(12): 1673–1681.
- 30. Strehlau J, Pavlakis M, Lipman ML, Shapiro M, Vasconcellos L, et al. (1997) Quantitative detection of immune activation transcripts as a diagnostic tool in kidney transplantation. Proc Natl Acad Sci USA 21 94(2): 695–700.
- 31. Li B, Hartono C, Ding R, Sharma VK, Ramaswamy R, et al. (2001) Noninvasive diagnosis of renal-allograft rejection by measurement of messenger RNA for perforin and granzyme B in urine. N Engl J Med 344: 947–954.
- 32. Øzbay A, Tørring C, Olsen R, Carstens J (2009) Transcriptional profiles in urine during acute rejection, bacteriuria, CMV infection and stable graft function after renal transplantation. Scand J Immunol 69(4): 357–365.
- 33. Galante NZ, Câmara NOS, Kallas EG, Salomão R, Pacheco-Silva A, et al. (2006) Noninvasive immune monitoring assessed by flow cytometry and real time RT-PCR in urine of renal transplantation recipients. Transpl Immunol 16(2): 73–80.
- 34. Shin GT, Kim SJ, Lee TS, Oh CK, Kim HS (2005) Gene expression of perforin by peripheral blood lymphocytes as a marker of acute rejection. Nephron Clin Pract 100(3): c63–70.
- 35. Simon T, Opelz G, Wiese M, Ott RC, Susal C (2003) Serial peripheral blood perforin and granzyme B gene expression measurements for prediction of acute rejection in kidney graft recipients. Am J Transplant 3(9): 1121–1127.
- 36. Dugr’e FJ, Gaudreau S, Belles-Isles M, Houde I, Roy R (2000) Cytokine and cytotoxic molecule gene expression determined in peripheral blood mononuclear cells in the diagnosis of acute renal rejection. Transplantation 15 70(7): 1074–1080.
- 37. Dias ECA, Veronese FJV, Gonçalves LFS, Manfro RC (2004) Molecular markers in subclinical acute rejection of renal transplants. Clin Transplant 18: 281–287.
- 38. Racusen LC, Solez K, Colvin RB (1999) The Banff 97 working classification of renal allograft pathology. Kidney Int 55: 713–723.
- 39. Colvin RB, Cohen AH, Saiontz C, Bonsib S, Buick M, et al. (1997) Evaluation of pathologic criteria of acute renal allograft rejection: Reproducibility, sensitivity, and clinical correlation. J Am Soc Nephrol 8: 1930–1941.