CD4 rate of increase is preferred to CD4 threshold for predicting outcomes among virologically suppressed HIV-infected adults on antiretroviral therapy

Sol Aldrete; Jeong Hoon Jang; Kirk A. Easley; Jason Okulicz; Tian Dai; Yi No Chen; Maria Pino; Brian K. Agan; Ryan C. Maves; Mirko Paiardini; Vincent C. Marconi

doi:10.1371/journal.pone.0227124

Abstract

Objectives

Immune non-responders (INR) have poor CD4 recovery and are associated with increased risk of serious events despite antiretroviral therapy (ART). A clinically relevant definition for INR is lacking.

Methods

We conducted a retrospective analysis of three large cohorts: Infectious Disease Clinic at the Atlanta Veterans Affairs Medical Center, the US Military HIV Natural History Study and Infectious Disease Program of the Grady Health System in Atlanta, Georgia. Two-stage modeling and joint model (JM) approaches were used to evaluate the association between CD4 (or CD4/CD8 ratio) slope within two years since ART initiation and a composite endpoint (AIDS, serious non-AIDS events and death) after two years of ART. We compared the predictive capacity of four CD4 count metrics (estimated CD4 slope, estimated CD4/CD8 ratio slope during two years following ART initiation and CD4 at 1 and 2 years following ART initiation) using Cox regression models.

Results

We included 2,422 patients. Mean CD4 slope (±standard error) during two years of ART was 102 ± 2 cells/μl/year (95% confidence interval: 98–106 cells/μl/year), this increase was uniform among the three cohorts (p = 0.80). There were 267 composite events after two years on ART. Using the JM approach, a CD4 slope ≥100 cells/μL/year or CD4/CD8 ratio slope >0.1 higher rate per year were associated with lower composite endpoint rates (adjusted hazard ratio [HR] = 0.80, p = 0.04 and HR = 0.75 p<0.01, respectively). All four CD4 metrics showed modest predictive capacity.

Conclusions

Using a complex JM approach, CD4 slope and CD4/CD8 ratio slope the first two years after ART initiation were associated with lower rates of the composite outcome. Moreover, the uniformity observed in the mean CD4 slope regardless of the cohort suggests a common CD4 response pattern independent of age or CD4 nadir. Given the consistency observed with CD4 slope, availability and ease of interpretation, this study provides strong rationale for using CD4 gains <100 cells/μl/year to identify patients at risk for adverse events.

Citation: Aldrete S, Jang JH, Easley KA, Okulicz J, Dai T, Chen YN, et al. (2020) CD4 rate of increase is preferred to CD4 threshold for predicting outcomes among virologically suppressed HIV-infected adults on antiretroviral therapy. PLoS ONE 15(1): e0227124. https://doi.org/10.1371/journal.pone.0227124

Editor: Graciela Andrei, Katholieke Universiteit Leuven Rega Institute for Medical Research, BELGIUM

Received: May 26, 2019; Accepted: December 12, 2019; Published: January 6, 2020

Copyright: © 2020 Aldrete et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All relevant data are within the manuscript and its Supporting Information files.

Funding: This work was supported by the National Institute of Allergy and Infectious Diseases at the National Institutes of Health [1R01AI110334] (VCM, MP); Emory Center for AIDS Research [P30AI050409] (VCM); and the Infectious Diseases Clinical Research Program (IDCRP) (BA), a DoD/USU program including federal funds from NIH/NIAID under Inter-Agency Agreement Y1-AI-5072. TD is a paid employee of Amgen. The specific role of this author is articulated in the 'author contributions' section. Amgen Inc did not play a role in the study design, data collection and analysis, decision to publish or provided other financial support to TD.

Competing interests: The authors of this study have read the journal's policy and the authors of this manuscript have the following competing interests: VCM has been the recipient of consulting honoraria from Lilly, ViiV, Gilead and Bayer. TD is a paid employee of Amgen. There are no patents, products in development or marketed products associated with this research to declare. This does not alter our adherence to PLOS ONE policies on sharing data and materials.

Introduction

The development of antiretroviral therapy (ART) has significantly changed the survival and prognosis of people living with HIV [1]. Most individuals who initiate ART experience sustained increases in their peripheral CD4⁺ T cell (CD4) counts, the hallmark of clinical recovery. Several studies have noted that there is a significant proportion of individuals who fail to restore their CD4 counts despite virologic suppression on ART for several years [2, 3]. In the literature, these individuals are labeled as discordant immune responders or immune non-responders (INR). Multiple factors have been associated with INR (i.e. older age, low CD4 nadir, long duration of HIV infection) but none of these factors provides a full explanation for the lack of immune reconstitution [4]. Additionally, INR have been associated with an increased risk of AIDS and serious non-AIDS events as well as mortality [5–7]. For these reasons, substantial efforts are being pursued to improve the identification and management of this key population [7–10].

There is no consensus in the literature on how best to define INR [7, 9]. Some studies define INR as a failure to achieve a pre-specified absolute CD4 count (threshold) at a particular time point [11–13] while others require a pre-specified increase in CD4 count irrespective of the initial value [14–17]. Most studies focus on a threshold (i.e. <200 or <350 cells/μl) derived from prior guidelines that determined timing of ART initiation and risk of opportunistic infections based on CD4 counts. Two studies even found a comparable morbidity and mortality rate to the general population for patients that achieve a CD4 >500 cells/μl [18, 19]. Recently, increasing emphasis has been placed on the CD4/CD8 ratio, as low values have been associated with increased immune activation and immunosenescence, which in turn have been associated with increased morbidity and mortality for people living with HIV [20, 21]. When examining the predictive capacity of these measures with long-term outcomes, there have been conflicting results given the diversity of populations studied, inclusion and exclusion criteria employed, and outcomes analyzed [7, 10].

In an effort to characterize clinical outcomes associated with INR, several analytic approaches have been used to quantify the relationship between longitudinal CD4 count data and time to event data. One approach has been to employ Cox proportional hazards regression models with time-dependent covariates (i.e. CD4 counts). However, standard statistical models such as the linear mixed model for longitudinal data and the Cox proportional hazards model for time-to-event data do not consider dependencies between these two different data types. Alternative approaches have been suggested in the biostatistics literature, such as two-stage modeling and joint modeling (JM) analyses, which enable both longitudinal repeated biomarker measurements and survival processes to be modeled together while accounting for the association between them, which leads to enhanced efficiency and correction of biases [22, 23].

In light of the clinical relevance of INR, the wide range of definitions available in the literature and the standard statistical models used to examine the association between CD4 counts and outcomes, the objective of this analysis was two-fold. The first aim was to identify a universal CD4 count or CD4/CD8 ratio recovery pattern most predictive of composite adverse events after two years since ART initiation across three diverse patient populations using a two-stage modeling and JM approach. The second aim was to assess and compare the predictive capacity of Cox regression models based on four continuous CD4 count metrics: CD4 counts at one year and at two years after initiating ART, estimated CD4 count slope and estimated CD4/CD8 ratio slope during the two years following ART initiation.

Methods

Study setting and population

We utilized data from three large, previously well-described clinical cohorts with distinct patient characteristics: the Infectious Disease Clinic at the Atlanta Veterans Affairs (VA) Medical Center (AVAMC) which is the largest HIV clinic in the VA [24, 25], the US Military HIV Natural History Study (NHS) [26] and the Infectious Disease Program (IDP) of the Grady Health System in Atlanta, Georgia which is one of the largest HIV clinics in the United States [27].

Patients were eligible for this study if they were ART naïve upon entry into the clinical cohort. Additionally, all patients had to achieve virologic suppression (VL <1,000 copies/μl) at six months or earlier after initiating ART and remain suppressed for at least the first two years after initiating ART. This VL threshold was chosen to overcome the heterogeneity of the assay detection limit used to quantify RNA among the distinct cohorts and eras (all patients started ART after 1995). Other demographic and clinical variables obtained included gender, race, age at baseline, VL measurements and nadir CD4 counts. Study follow-up time was censored after 12 years from the date of ART initiation.

Definitions

Length of follow up was defined from ART start to the latest CD4 measurement available for each patient. The composite endpoint of interest was the first occurrence of any of the following events after two years of ART initiation and before censoring: an acute cardiovascular disease event (myocardial infarction, acute transient ischemic attack/stroke, cardiac arrest, acute congestive heart failure), an AIDS-defining illness (excluding a CD4 <200), malignancy (excluding benign tumors or skin cancer), end-stage renal disease requiring hemodialysis, liver disease (acute liver failure or cirrhosis), significant infections (bacterial pneumonia, bacterial meningitis, endocarditis or influenza), pulmonary disease (COPD) or death. For the AVAMC and IDP, outcomes were abstracted from electronic health registry data using International Classification of Diseases-9 (ICD-9) codes. For the NHS, the clinical diagnoses were mapped onto equivalent ICD-9 codes.

Institutional Review Board approval

The NHS cohort has been approved by the Institutional Review Board (IRB) centrally (Uniformed Services University of the Health Sciences, Bethesda, MD) and at each participating center (Walter Reed National Military Medical Center, Bethesda, MD; Naval Medical Center, Portsmouth, VA; San Antonio Military Medical Center, TX; Naval Medical Center, San Diego, CA; and Tripler Army Medical Center, Honolulu, HI). Written consent was obtained from each patient. The AVAMC cohort involved a secondary analysis of electronic health record (EHR) data that was approved by the Emory University IRB and that Atlanta VA Medical Center Research and Development Committee. The AVAMC analysis had an IRB-approved HIPAA waiver and therefore did not require informed consent. The IDP cohort was also a secondary analysis of data from the Center for AIDS Research (CFAR) HIV Data Registry within the Grady Health System. The Registry contains EHR data from patients who received medical treatment at the Ponce de Leon Center IDP. This analysis also has an IRB-approved HIPAA waiver and did not require informed consent.

Statistical analysis

Patient demographic and clinical characteristics were compared between the cohort groups with the one-way analysis of variance (ANOVA) F-test for continuous variables and the chi-square test for categorical variables. Cumulative composite rates were estimated using the Kaplan-Meier method and composite rates between immune responders and INR were compared by the log-rank test. Hazard ratios were calculated to measure the degree of association between the demographic and baseline clinical characteristics and the composite outcome by fitting the Cox proportional-hazards regression model separately for each baseline characteristic.

Association analyses via CD4 modeling.

The primary predictor of interest was the CD4 count slope during the two years following ART initiation. Two approaches were used to evaluate the association between the CD4 count slope and the composite endpoint, two-stage modeling and JM. Details about the statistical methods used are provided in the S1 Appendix. The unadjusted hazard ratios for the composite endpoint were summarized per 50 or 100 cells/μL/year increase in CD4 slopes and per 50 or 100 cells/μL increase in CD4 intercepts for ease of interpretation of the regression coefficients. Adjusted hazard ratios (HR) and their 95% confidence intervals were obtained using a multivariable Cox model including gender, race, baseline age group (≤ 37 or >37 at baseline), study cohort and estimated CD4 slope and intercept.

We also examined the relationship between the composite outcome rate and the CD4 recovery status, as indicated by a slower or faster rate of CD4 count increase in the first two years after ART initiation. Specifically, the estimated CD4 slopes during the two years following ART initiation from the linear mixed-effects model were dichotomized at the median to categorize patients as immune non-responders (INR ≤100 cells/μL/year) or immune responders (IR >100 cells/μL/year), and then the cumulative incidence of the composite outcome by the CD4 recovery status was calculated. Next, using the CD4 recovery status as a binary predictor variable and the composite outcome as a clinical endpoint, we conducted Cox proportional hazards regression analyses, including adjustment for gender, race, baseline age group and estimated CD4 intercept. The degree of effect modification by age was visualized by plotting the 10-year cumulative incidence smoothed over the entire age range and stratified by the CD4 recovery status.

Association analyses via CD4/CD8 ratio modeling.

Another predictor of interest was CD4/CD8 ratio slope during the two years following ART initiation. The two aforementioned approaches, two-stage modeling and JM were repeatedly adopted to evaluate the association between the CD4/CD8 ratio slope and the composite endpoint. See S1 Appendix for more details.

Comparison of CD4 count metrics.

This analysis focused on assessing and comparing the predictive ability of the Cox regression models based on four continuous CD4 count metrics: (i) estimated CD4 slope during the two years following ART initiation (two-stage model approach); (ii) estimated CD4/CD8 ratio slope during the two years following ART initiation (two-stage model approach); (iii) CD4 cell counts at 1 year after initiating ART; and (iv) CD4 cell counts at 2 years after initiating ART. For the two-latter metrics, CD4 counts closest to the first and second year of ART were used, respectively. The Cox models were also further adjusted for study cohort, age at baseline and gender in subsequent analyses. Time-dependent receiver operating characteristic (ROC) curves, area under the time-dependent ROC curves (AUC) and Uno’s C-statistics were used to assess and compare the discriminative performance of the final prediction model. All three statistics were appropriate for right-censored data.

All statistical analyses were conducted using SAS software version 9.4 (SAS Institute Inc, Cary, NC). Statistical significance was evaluated at a type I error type of 0.05. All statistical tests were 2-sided. JM were fit using a SAS macro JMFit [28]. The S2 Appendix provides SAS code for conducting two-stage modeling and JM analyses.

Results

Patient characteristics

The combined study cohort included 2,422 ART naïve patients who became virologically suppressed after ART initiation and remained suppressed for at least two years (Table 1). The mean age at ART initiation was 37.6 years, most were male (87%) and African-American (62%). At the start of ART, mean CD4 count was 244 cells/μL (standard deviation [SD] = 208) and mean CD4 nadir was 208 cells/μL (SD = 177). Median follow up was 5.4 years for patients without the composite endpoint (interquartile range [IQR], 3.4–7.9 years). The three cohort groups differed significantly in age at baseline, ethnicity, CD4 nadir and CD4 count at baseline. There were 267 composite endpoints after two years on ART. 73 (27.3%) were AIDS-related events, 67 (25%) were related to infections, 47 (17.6%) were cancer, 42 (15.7%) were cardiovascular events, 16 (6%) related to liver events, 10 (3.7%) pulmonary events, 3 (1.1%) renal events and 9 deaths.

Download:

Table 1. Demographic and clinical characteristics by cohort.

https://doi.org/10.1371/journal.pone.0227124.t001

CD4 count and CD4/CD8 ratio characteristics

The estimated CD4 slope (mean ± standard error [SE]) was 102 ± 2 cells/μL/year. The mean CD4 count at one year and at two years was 427 cells/μL and 530 cells/μL, respectively. The mean CD4 intercept, mean CD4 count at year 1 and at year 2 were significantly different between the three cohorts, but there were no differences in the mean CD4 slopes (p = 0.80; Table 2; S1A Fig). The estimated CD4/CD8 ratio slope (mean± SE) was 0.169 ± 0.003. The mean CD4/CD8 ratio intercept, slope and ratio at one and two years were significantly different between the three cohorts (S1 Table and S1D Fig).

Download:

Table 2. Estimated^{^a} mean CD4 intercept (cell/μL), estimated mean CD4 count (cell/μL) after 1 and 2 years from ART initiation and the estimated mean CD4 slope (cell/μL/year) during the two years following ART initiation by cohort, CD4 recovery status and baseline age group.

https://doi.org/10.1371/journal.pone.0227124.t002

When comparing IR to INR (≤100 cells/μL/year) based on our a priori definition, the mean CD4 slope was significantly different (IR 178 ±2 vs. INR 38 ±2 cells/μL/year, P <0.0001) despite starting at the same mean CD4 intercept (P = 0.87; S1B Fig). For the ratio, the mean CD4/CD8 intercept and slope were significantly different between IR and INR (S1E Fig).

CD4 modeling

For the two-stage model approach, the unadjusted analysis showed a significant association between CD4 slope in the first two years of ART and the composite endpoint (P = 0.02; Table 3). This effect was maintained for the adjusted analysis (P = 0.04; Table 3). Likewise, under the JM approach, a higher CD4 slope in the first two years of ART was associated with a lower likelihood of developing the composite endpoint in the unadjusted analysis (P = 0.02; Table 3). This effect was also observed in the adjusted analysis for the 50 cells/μL/year increase (HR = 0.90, 95% CI: 0.81–0.99, P = 0.04), or equivalently for the 100 cells/μL/year increase (HR = 0.80, 95% CI: 0.65–0.99, P = 0.04; Table 3). For both approaches, CD4 intercept exhibited a highly significant association with the composite outcome in the unadjusted analysis (P <0.01) but did not show an association in the adjusted analyses. The hazard ratios were very similar in a sensitivity analysis of the subset of 1,837 patients who remains virologically suppressed (VL <1,000 copies/μl) throughout their follow up.

Download:

Table 3. Association between estimated CD4 intercept and CD4 slope during the two years following ART initiation with risk of composite endpoint^{^a}.

https://doi.org/10.1371/journal.pone.0227124.t003

When evaluating the association between CD4/CD8 ratio slope in the first two years of ART with the composite endpoint, the two-stage model approach showed a significant association with 0.1 or 0.2 higher rate per year increase (P <0.01). This effect was maintained for the adjusted analysis of both CD4/CD8 ratio increases. In the JM approach, a 0.1 and 0.2 higher rate per year increase were significant in the unadjusted and adjusted analyses (S2 Table).

The 10-year cumulative incidence rate of the composite endpoint was 15.7% (95% CI: 12.6%-19.5%) for IR versus 25.9% (95% CI: 21.9%-30.5%) for INR (P <0.01; Fig 1A). For the CD4/CD8 ratio, IR (CD4/CD8 ratio slope >0.15 per year) had a composite outcome of 14.2% (95% CI: 11.3%-17.7%) versus 28.8% (95% CI: 24.4%-33.9%) for INR (Fig 1B).

Download:

Fig 1.

(a) Cumulative composite outcome endpoint rates by CD4 recovery status. Responders had CD4 slope >100 cells/μL/year. Estimated with the Kaplan-Meier method and compared by the log-rank test (p < 0·01). The median follow-up time estimated by a reverse Kaplan-Meier method was 5.5 years (95% CI: 5.3–5.6). (b) Cumulative composite outcome endpoint rates by CD4/CD8 recovery status. Responders had CD4/CD8 ratio slope >0.15 per year. Estimated with the Kaplan-Meier method and compared by the log-rank test (p < 0·01). The median follow-up time estimated by a reverse Kaplan-Meier method was 5.5 years (95% CI: 5.3–5.6).

https://doi.org/10.1371/journal.pone.0227124.g001

Effect modification analysis suggests a difference across levels of age for both CD4 slope and CD4/CD8 ratio slope (P = 0.07 and 0.03 for the statistical interaction between age and immune response by CD4 slope and CD4/CD8 ratio slope, respectively). For the CD4 slope, the composite endpoint rate decreased 39% among older IR (above the median age of 37 years) compared to older INR (HR = 0.61, 95% CI: 0.44–0.84, P = 0.003, S3 Table). This effect was not seen in the younger population (S3 Table). A similar effect modification was observed for the CD4/CD8 ratio slope (S4 Table).

Fig 2A and 2B provides smoothed 10-year cumulative composite rate curves for IR and INR (CD4 slope and CD4/CD8 ratio) by baseline age. The cumulative incident rates were lower for IR at all ages with increasing discrepancy between the two groups over age.

Download:

Fig 2.

Smoothed cumulative composite outcome endpoint rate curves and their 95% confidence intervals at 10 years from ART initiation by age and immune status (2a: CD4 recovery status; 2b: CD4/CD8 ratio recovery status).

https://doi.org/10.1371/journal.pone.0227124.g002

CD4 metrics comparison

Finally, we evaluated the predictive accuracy of the Cox regression models for the composite endpoint employing the four continuous CD4 metrics previously mentioned. For the four prognostic factors, the 5-year and 10-year (S2A and S2B Fig) AUC values ranged from 0.59 to 0.63 and 0.66 to 0.70, respectively, with those of the estimated CD4/CD8 ratio slope being the highest at both time points. The time-dependent AUC curves for the four prognostic factors exhibited nearly identical patterns, hovering above 0.65 at earlier and later time points, but falling to about 0.6 in between, while that of the estimated CD4/CD8 ratio slope attained highest values over most of the study period (S2C Fig). In terms of the Uno’s C-statistic, the estimated CD4/CD8 ratio slope appeared to provide significantly higher prognostic information compared to other prognostic factors (S5 Table). Prediction of the composite endpoint generally improved and was more similar among the four prognostic factors using the adjusted Cox regression models. For each of the prognostic factors, both the 5-year and 10-year AUC values were approximately 0.70 (Fig 3A and 3B), and the time-dependent AUC curve hovered around 0.70 over most of the study period (Fig 3C), suggesting acceptable (fair) predictive accuracy of the composite endpoint with the Cox regression models. Uno’s C-statistics were between 0.64 and 0.66 without any significant difference among the prognostic factors (S5 Table).

Download:

Fig 3.

Time-dependent ROC curves at (3a) 5 and (3b) 10 years from ART initiation and (3c) time-dependent AUCs evaluated over the 10-year study period (baseline at second year of continuous ART). Cox regression models include (i) Estimated CD4 slope (ii) Estimated CD4/CD8 ratio slope (iii) CD4 counts after 1 year and (iv) CD4 counts after 2 years as main predictors, respectively, and adjusted for estimated CD4 intercept or estimated CD4/CD8 ratio or baseline CD4 count, depending on the choice of the prognostic risk factor, and commonly adjusted for age at baseline, gender and study cohort.

https://doi.org/10.1371/journal.pone.0227124.g003

Discussion

Considering the significant morbidity and mortality associated with INR, we were interested in identifying the CD4 count and CD4/CD8 ratio recovery pattern most predictive of long-term outcomes in HIV patients who started ART and remained suppressed for the first two years. In our combined study cohort, we found that both CD4 slope (>100 cells/μl) and CD4/CD8 ratio slope (>0.1 higher per year) during the first two years after ART initiation were associated with lower rates of the composite endpoint. Prior studies have found similar results, a CD4 slope <100 cells/μl has been used to define INR in association with developing new AIDS defining illness [16] or mortality [14] and other studies have equally reported on the inverse relationship between the CD4/CD8 ratio and risk of cardiovascular events [29], serious non-AIDS events and deaths[30]. However, we believe our study offers an advantage to prior statistical analysis performed in that we used a complex modeling approach to explore the longitudinal relationship between CD4 counts and composite clinical events which allows to consider the dependencies between these two different data types and reduces substantial bias that emerges with other biostatistical approaches. To our knowledge, this is the first study in the literature using a JM approach to explore the relationship of CD4 recovery and composite clinical events. All the studies published to date have been limited to biostatistical modeling without providing clinical endpoints [22, 31–33].

We also found that age at ART initiation had a significant effect on both the immune response for CD4 slope and CD4/CD8 ratio slope. The effect of age on immune recovery has been previously described [2, 21], and it is well known that younger age is associated with higher absolute CD4 cell gain and shorter time to a maximum response independent of baseline CD4 [34]. Age has also been found to be an independent predictor of long-term outcomes [35]. In our study, we found a marked difference in the association between the immune recovery and risk of the composite endpoint based on age (>37 years old). The fact that this effect was not observed in younger INR could be due to either lower levels of immune activation or presenting for care soon after infection.

Given the wide range of INR definitions in the literature (S3 Appendix) and the challenges associated with performing a meta-analysis, our second aim was to compare the most common CD4 metrics used in the literature. In our case, a direct comparison by cutpoints created by dichotomizing continuous prognostic factors such as CD4 count was not attempted due to several serious drawbacks: loss of power and precision due to data loss, “optimal” cut points do not replicate across studies; and cut points are arbitrary and can be manipulated [36, 37]. In contrast to other studies which have looked at the prognostic role of various specifications of CD4 recovery and outcomes via cox regression models and hazard ratios [35, 38], we examined time-dependent ROC curves, time-dependent AUCs and Uno’s C-statistics to assess and compare the discriminative performance of the final prediction model. All four CD4 metrics were modest predictors of the composite outcome. Although there was a trend for the CD4/CD8 ratio to do slightly better, formally comparing the difference between all pairwise AUCs at 5 and 10 years provided evidence that none of the markers were superior as a predictor of the composite endpoint in the unadjusted and adjusted analysis.

Recent experts have recommended less frequent CD4 monitoring in virologically suppressed individuals who start therapy at high CD4 counts[39]. However, current DHHS guidelines still recommend regular CD4 monitoring (i.e. every 3–6 months) during the first two years of ART and then annually if CD4 remains below 500 cells/μl[8]. Our study supports the importance of monitoring the initial CD4 response within the first two years after ART initiation and provides validity for these results even in patients starting with high CD4 counts (i.e. NHS cohort).

Study strengths included a multicenter study of three different cohorts which differed in age, baseline CD4 count and time to ART initiation allowing for a broader application of our results. Additionally, this analysis included a composite endpoint and not just mortality. A sub-analysis excluding the pulmonary outcomes and influenza diagnoses yielded similar results. In addition, the JM approach, although complex and labor intensive, decreased the potential for bias and allowed for simultaneous modeling of both the repeated CD4 count measurements and clinical endpoint [33].

Our study has several limitations. First, our analysis was retrospective with two of the cohorts utilizing clinical observational data. Second, there could have been residual confounding from unmeasured patient characteristics that affected the CD4 response (i.e. seroconversion date, hepatitis B or C infection, ART). Third, we used an expansive definition for viral suppression, allowing patients to remain in the analysis if their plasma HIV viral load levels remained <1000 copies/μl although this definition has been used by other studies[3, 6, 17]. A sub-analysis for the patients with a viral load ≤400 or ≤200 copies/μl reduced the population being evaluated but gave results with a similar trend. An additional sub-analysis on those patients who remained virologically suppressed (VL <1000 copies/μl) through out their follow up showed a similar trend.

When looking at the JM analysis, our study found that both CD4 slope and CD4/CD8 ratio slope were associated with lower rates of the composite outcome. However, we believe CD4 slope is more practical to use in a clinical setting as it is more readily available and easy to interpret. Moreover, the mean CD4 slope was the same in each cohort while the starting and final CD4 counts and CD4/CD8 ratio were different. These findings suggest a common CD4 response pattern among patients, independent of age, race and CD4 at ART initiation. By using the rate to identify INR, instead of a threshold, we were able to include populations with different clinical characteristics allowing for a more widespread application of our findings. In addition, this might also suggest that patients who have a high CD4 baseline are still at risk of adverse clinical events if their CD4 counts do not increase appropriately after starting ART. In conclusion, an average CD4 count increase >100 cells/μL/year predicts better clinical outcomes. Among those with CD4 gains ≤100, increased monitoring for adverse clinical events may be warranted. The next steps will be to incorporate additional variables into these models to enhance their predictive accuracy.

Supporting information

S1 Appendix. Supplementary methods.

https://doi.org/10.1371/journal.pone.0227124.s001

(DOCX)

S2 Appendix. SAS v9.4 code for conducting two-stage modeling and joint modeling analyses.

https://doi.org/10.1371/journal.pone.0227124.s002

(DOCX)

S3 Appendix. INR definitions in the literature.

https://doi.org/10.1371/journal.pone.0227124.s003

(DOCX)

S1 Table. Estimateda mean CD4/CD8 ratio intercept, estimated mean CD4/CD8 ratio after 1 and 2 years from ART initiation and the estimated mean CD4/CD8 ratio slope (per year) during the two years following ART initiation with treatment interruptions of less than 2 months by cohort, CD4/CD8 ratio recovery status and baseline age group.

https://doi.org/10.1371/journal.pone.0227124.s004

(DOCX)

S2 Table. Association of estimated CD4/CD8 ratio slope and intercept during the two years following ART initiation with risk of composite endpoint.

https://doi.org/10.1371/journal.pone.0227124.s005

(DOCX)

S3 Table. Association between patient CD4 recovery status based on estimated CD4 slope and risk of composite endpoint by baseline age group, gender and race.

https://doi.org/10.1371/journal.pone.0227124.s006

(DOCX)

S4 Table. Association between patient CD4/CD8 ratio recovery status based on estimated CD4/CD8 ratio slope and risk of composite endpoint by baseline age group, gender and race.

https://doi.org/10.1371/journal.pone.0227124.s007

(DOCX)

S5 Table. Comparison of Uno’s C-statistics among the four prognostic risk factors: (i) Estimated CD4 slope (ii) Estimated CD4/CD8 ratio slope (iii) CD4 counts after 1 year and (iv) CD4 counts after 2 years.

https://doi.org/10.1371/journal.pone.0227124.s008

(DOCX)

S1 Fig.

Estimated mean CD4 cell counts (cells/ μL) (left panel) and estimated mean CD4/CD8 ratio (right panel) at baseline and after 1 and 2 years in the first 2 years on continuous ART for at least 24 months by study cohort (S1a, S1d), immune status (S1b, S1e) and age at baseline (S1c, S1f). Vertical bars are 95% confidence intervals.

https://doi.org/10.1371/journal.pone.0227124.s009

(TIF)

S2 Fig.

(a) CD4 metrics time-dependent ROC curves at 5 years from ART initiation. (b) CD4 metrics time-dependent ROC curves at 10 years from ART initiation. (c) CD4 metrics time-dependent AUCs evaluated over the 10-year study period.

https://doi.org/10.1371/journal.pone.0227124.s010

(TIF)

Acknowledgments

We are grateful to the patients and clinical staff at the IDP for their generous contributions to this work, especially Theron Stuart, Cameron England Tran, Tanisha Sullivan, Ericka Patrick, Minh Nguyen and Jeselyn Rhodes. The authors would like to acknowledge Grady Health System and the Ponce de Leon Center IDP. The contents of this publication are the sole responsibility of the authors and do not necessarily reflect the views, opinions or policies of Uniformed Services University of the Health Sciences (USUHS), the Henry M. Jackson Foundation for the Advancement of Military Medicine, INC., the Department of Defense (DoD), the Departments of the Army, Navy, or Air Force, or the Naval Medical Center San Diego or Brooke Army Medical Center. Mention of trade names, commercial products, or organizations does not imply endorsement by the U.S. Government.

Presented in part as a poster in Boston for the international Conference on Retrovirus and Opportunistic Infections, March 2018.

References

1. Palella FJ Jr., Delaney KM, Moorman AC, Loveless MO, Fuhrer J, Satten GA, et al. Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. HIV Outpatient Study Investigators. N Engl J Med. 1998;338(13):853–60. pmid:9516219
- View Article
- PubMed/NCBI
- Google Scholar
2. Kaufmann GR, Perrin L, Pantaleo G, Opravil M, Furrer H, Telenti A, et al. CD4 T-lymphocyte recovery in individuals with advanced HIV-1 infection receiving potent antiretroviral therapy for 4 years: the Swiss HIV Cohort Study. Arch Intern Med. 2003;163(18):2187–95. pmid:14557216
- View Article
- PubMed/NCBI
- Google Scholar
3. Kelley CF, Kitchen CM, Hunt PW, Rodriguez B, Hecht FM, Kitahata M, et al. Incomplete peripheral CD4+ cell count restoration in HIV-infected patients receiving long-term antiretroviral treatment. Clin Infect Dis. 2009;48(6):787–94. pmid:19193107
- View Article
- PubMed/NCBI
- Google Scholar
4. Gaardbo JC, Hartling HJ, Gerstoft J, Nielsen SD. Incomplete immune recovery in HIV infection: mechanisms, relevance for clinical care, and possible solutions. Clin Dev Immunol. 2012;2012:670957. pmid:22474480
- View Article
- PubMed/NCBI
- Google Scholar
5. Gutierrez F, Padilla S, Masia M, Iribarren JA, Moreno S, Viciana P, et al. Clinical outcome of HIV-infected patients with sustained virologic response to antiretroviral therapy: long-term follow-up of a multicenter cohort. PLoS One. 2006;1:e89. pmid:17183720
- View Article
- PubMed/NCBI
- Google Scholar
6. Pacheco YM, Jarrin I, Rosado I, Campins AA, Berenguer J, Iribarren JA, et al. Increased risk of non-AIDS-related events in HIV subjects with persistent low CD4 counts despite cART in the CoRIS cohort. Antiviral Res. 2015;117:69–74. pmid:25766861
- View Article
- PubMed/NCBI
- Google Scholar
7. Kelly C, Gaskell KM, Richardson M, Klein N, Garner P, MacPherson P. Discordant Immune Response with Antiretroviral Therapy in HIV-1: A Systematic Review of Clinical Outcomes. PLoS One. 2016;11(6):e0156099. pmid:27284683
- View Article
- PubMed/NCBI
- Google Scholar
8. Adolescents PoAGfAa. Guidelines for the use of antiretroviral agents in HIV-1-infected adults and adolescents. Department of Health and Human Services. http://www.aidsinfo.nih.gov/ContentFiles/AdultandAdolescentGL.pdf [
9. Cenderello G, De Maria A. Discordant responses to cART in HIV-1 patients in the era of high potency antiretroviral drugs: clinical evaluation, classification, management prospects. Expert Rev Anti Infect Ther. 2016;14(1):29–40. pmid:26513236
- View Article
- PubMed/NCBI
- Google Scholar
10. Achhra AC, Petoumenos K, Law MG. Relationship between CD4 cell count and serious long-term complications among HIV-positive individuals. Curr Opin HIV AIDS. 2014;9(1):63–71. pmid:24275674
- View Article
- PubMed/NCBI
- Google Scholar
11. Lederman MM, Calabrese L, Funderburg NT, Clagett B, Medvik K, Bonilla H, et al. Immunologic failure despite suppressive antiretroviral therapy is related to activation and turnover of memory CD4 cells. J Infect Dis. 2011;204(8):1217–26. pmid:21917895
- View Article
- PubMed/NCBI
- Google Scholar
12. Engsig FN, Zangerle R, Katsarou O, Dabis F, Reiss P, Gill J, et al. Long-term mortality in HIV-positive individuals virally suppressed for >3 years with incomplete CD4 recovery. Clin Infect Dis. 2014;58(9):1312–21. pmid:24457342
- View Article
- PubMed/NCBI
- Google Scholar
13. Kaufmann GR, Furrer H, Ledergerber B, Perrin L, Opravil M, Vernazza P, et al. Characteristics, determinants, and clinical relevance of CD4 T cell recovery to <500 cells/microL in HIV type 1-infected individuals receiving potent antiretroviral therapy. Clin Infect Dis. 2005;41(3):361–72. pmid:16007534
- View Article
- PubMed/NCBI
- Google Scholar
14. Gilson RJ, Man SL, Copas A, Rider A, Forsyth S, Hill T, et al. Discordant responses on starting highly active antiretroviral therapy: suboptimal CD4 increases despite early viral suppression in the UK Collaborative HIV Cohort (UK CHIC) Study. HIV Med. 2010;11(2):152–60. pmid:19732175
- View Article
- PubMed/NCBI
- Google Scholar
15. Tan R, Westfall AO, Willig JH, Mugavero MJ, Saag MS, Kaslow RA, et al. Clinical outcome of HIV-infected antiretroviral-naive patients with discordant immunologic and virologic responses to highly active antiretroviral therapy. J Acquir Immune Defic Syndr. 2008;47(5):553–8. pmid:18285713
- View Article
- PubMed/NCBI
- Google Scholar
16. Nicastri E, Chiesi A, Angeletti C, Sarmati L, Palmisano L, Geraci A, et al. Clinical outcome after 4 years follow-up of HIV-seropositive subjects with incomplete virologic or immunologic response to HAART. J Med Virol. 2005;76(2):153–60. pmid:15834865
- View Article
- PubMed/NCBI
- Google Scholar
17. Grabar S, Le Moing V, Goujard C, Leport C, Kazatchkine MD, Costagliola D, et al. Clinical outcome of patients with HIV-1 infection according to immunologic and virologic response after 6 months of highly active antiretroviral therapy. Ann Intern Med. 2000;133(6):401–10. pmid:10975957
- View Article
- PubMed/NCBI
- Google Scholar
18. Lewden C, Chene G, Morlat P, Raffi F, Dupon M, Dellamonica P, et al. HIV-infected adults with a CD4 cell count greater than 500 cells/mm3 on long-term combination antiretroviral therapy reach same mortality rates as the general population. J Acquir Immune Defic Syndr. 2007;46(1):72–7. pmid:17621240
- View Article
- PubMed/NCBI
- Google Scholar
19. Rodger AJ, Lodwick R, Schechter M, Deeks S, Amin J, Gilson R, et al. Mortality in well controlled HIV in the continuous antiretroviral therapy arms of the SMART and ESPRIT trials compared with the general population. AIDS. 2013;27(6):973–9. pmid:23698063
- View Article
- PubMed/NCBI
- Google Scholar
20. Lu W, Mehraj V, Vyboh K, Cao W, Li T, Routy JP. CD4:CD8 ratio as a frontier marker for clinical outcome, immune dysfunction and viral reservoir size in virologically suppressed HIV-positive patients. J Int AIDS Soc. 2015;18:20052. pmid:26130226
- View Article
- PubMed/NCBI
- Google Scholar
21. Deeks SG. HIV infection, inflammation, immunosenescence, and aging. Annu Rev Med. 2011;62:141–55. pmid:21090961
- View Article
- PubMed/NCBI
- Google Scholar
22. Lim H, Mondal P, Sinner S. Joint modeling of longitudinal and event time data: application to HIV study. Journal of Medical Statistics and Informatics 2013;1.
- View Article
- Google Scholar
23. Wulfsohn MS, Tsiatis AA. A joint model for survival and longitudinal data measured with error. Biometrics. 1997;53(1):330–9. pmid:9147598
- View Article
- PubMed/NCBI
- Google Scholar
24. Guest JL, Weintrob AC, Rimland D, Rentsch C, Bradley WP, Agan BK, et al. A comparison of HAART outcomes between the US military HIV Natural History Study (NHS) and HIV Atlanta Veterans Affairs Cohort Study (HAVACS). PLoS One. 2013;8(5):e62273. pmid:23658717
- View Article
- PubMed/NCBI
- Google Scholar
25. Guest JL, Moanna A, Schlueter Wirtz S, Caruth EC, Rentsch C, Marconi VC, et al. Cohort Profile: The HIV Atlanta Veterans Affairs Cohort Study (HAVACS). Int J Epidemiol. 2017;46(5):1727. pmid:29025043
- View Article
- PubMed/NCBI
- Google Scholar
26. Marconi VC, Grandits GA, Weintrob AC, Chun H, Landrum ML, Ganesan A, et al. Outcomes of highly active antiretroviral therapy in the context of universal access to healthcare: the U.S. Military HIV Natural History Study. AIDS Res Ther. 2010;7:14. pmid:20507622
- View Article
- PubMed/NCBI
- Google Scholar
27. Colasanti J, Kelly J, Pennisi E, Hu YJ, Root C, Hughes D, et al. Continuous Retention and Viral Suppression Provide Further Insights Into the HIV Care Continuum Compared to the Cross-sectional HIV Care Cascade. Clin Infect Dis. 2016;62(5):648–54. pmid:26567263
- View Article
- PubMed/NCBI
- Google Scholar
28. Zhang D, Chen MH, Ibrahim JG, Boye ME, Shen W. JMFit: A SAS Macro for Joint Models of Longitudinal and Survival Data. J Stat Softw. 2016;71(3). pmid:27616941
- View Article
- PubMed/NCBI
- Google Scholar
29. Castilho JL, Shepherd BE, Koethe J, Turner M, Bebawy S, Logan J, et al. CD4+/CD8+ ratio, age, and risk of serious noncommunicable diseases in HIV-infected adults on antiretroviral therapy. AIDS. 2016;30(6):899–908. pmid:26959354
- View Article
- PubMed/NCBI
- Google Scholar
30. Mussini C, Lorenzini P, Cozzi-Lepri A, Lapadula G, Marchetti G, Nicastri E, et al. CD4/CD8 ratio normalisation and non-AIDS-related events in individuals with HIV who achieve viral load suppression with antiretroviral therapy: an observational cohort study. Lancet HIV. 2015;2(3):e98–106. pmid:26424550
- View Article
- PubMed/NCBI
- Google Scholar
31. Song X, Davidian M, Tsiatis AA. A semiparametric likelihood approach to joint modeling of longitudinal and time-to-event data. Biometrics. 2002;58(4):742–53. pmid:12495128
- View Article
- PubMed/NCBI
- Google Scholar
32. Rizopoulos D. Dynamic predictions and prospective accuracy in joint models for longitudinal and time-to-event data. Biometrics. 2011;67(3):819–29. pmid:21306352
- View Article
- PubMed/NCBI
- Google Scholar
33. Brombin C, Di Serio C, Rancoita PM. Joint modeling of HIV data in multicenter observational studies: A comparison among different approaches. Stat Methods Med Res. 2016;25(6):2472–87. pmid:24671658
- View Article
- PubMed/NCBI
- Google Scholar
34. Viard JP, Mocroft A, Chiesi A, Kirk O, Roge B, Panos G, et al. Influence of age on CD4 cell recovery in human immunodeficiency virus-infected patients receiving highly active antiretroviral therapy: evidence from the EuroSIDA study. J Infect Dis. 2001;183(8):1290–4. pmid:11262215
- View Article
- PubMed/NCBI
- Google Scholar
35. van Lelyveld SF, Gras L, Kesselring A, Zhang S, De Wolf F, Wensing AM, et al. Long-term complications in patients with poor immunological recovery despite virological successful HAART in Dutch ATHENA cohort. AIDS. 2012;26(4):465–74. pmid:22112603
- View Article
- PubMed/NCBI
- Google Scholar
36. Altman DG, Royston P. The cost of dichotomising continuous variables. BMJ. 2006;332(7549):1080. pmid:16675816
- View Article
- PubMed/NCBI
- Google Scholar
37. Royston P, Altman DG, Sauerbrei W. Dichotomizing continuous predictors in multiple regression: a bad idea. Stat Med. 2006;25(1):127–41. pmid:16217841
- View Article
- PubMed/NCBI
- Google Scholar
38. Takuva S, Maskew M, Brennan AT, Long L, Sanne I, Fox MP. Poor CD4 recovery and risk of subsequent progression to AIDS or death despite viral suppression in a South African cohort. J Int AIDS Soc. 2014;17:18651. pmid:24594114
- View Article
- PubMed/NCBI
- Google Scholar
39. Sax PE. Editorial commentary: can we break the habit of routine CD4 monitoring in HIV care? Clin Infect Dis. 2013;56(9):1344–6. pmid:23315314
- View Article
- PubMed/NCBI
- Google Scholar

[ref1] 1. Palella FJ Jr., Delaney KM, Moorman AC, Loveless MO, Fuhrer J, Satten GA, et al. Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. HIV Outpatient Study Investigators. N Engl J Med. 1998;338(13):853–60. pmid:9516219
View Article
PubMed/NCBI
Google Scholar

[2] View Article

[3] PubMed/NCBI

[4] Google Scholar

[ref2] 2. Kaufmann GR, Perrin L, Pantaleo G, Opravil M, Furrer H, Telenti A, et al. CD4 T-lymphocyte recovery in individuals with advanced HIV-1 infection receiving potent antiretroviral therapy for 4 years: the Swiss HIV Cohort Study. Arch Intern Med. 2003;163(18):2187–95. pmid:14557216
View Article
PubMed/NCBI
Google Scholar

[6] View Article

[7] PubMed/NCBI

[8] Google Scholar

[ref3] 3. Kelley CF, Kitchen CM, Hunt PW, Rodriguez B, Hecht FM, Kitahata M, et al. Incomplete peripheral CD4+ cell count restoration in HIV-infected patients receiving long-term antiretroviral treatment. Clin Infect Dis. 2009;48(6):787–94. pmid:19193107
View Article
PubMed/NCBI
Google Scholar

[10] View Article

[11] PubMed/NCBI

[12] Google Scholar

[ref4] 4. Gaardbo JC, Hartling HJ, Gerstoft J, Nielsen SD. Incomplete immune recovery in HIV infection: mechanisms, relevance for clinical care, and possible solutions. Clin Dev Immunol. 2012;2012:670957. pmid:22474480
View Article
PubMed/NCBI
Google Scholar

[14] View Article

[15] PubMed/NCBI

[16] Google Scholar

[ref5] 5. Gutierrez F, Padilla S, Masia M, Iribarren JA, Moreno S, Viciana P, et al. Clinical outcome of HIV-infected patients with sustained virologic response to antiretroviral therapy: long-term follow-up of a multicenter cohort. PLoS One. 2006;1:e89. pmid:17183720
View Article
PubMed/NCBI
Google Scholar

[18] View Article

[19] PubMed/NCBI

[20] Google Scholar

[ref6] 6. Pacheco YM, Jarrin I, Rosado I, Campins AA, Berenguer J, Iribarren JA, et al. Increased risk of non-AIDS-related events in HIV subjects with persistent low CD4 counts despite cART in the CoRIS cohort. Antiviral Res. 2015;117:69–74. pmid:25766861
View Article
PubMed/NCBI
Google Scholar

[22] View Article

[23] PubMed/NCBI

[24] Google Scholar

[ref7] 7. Kelly C, Gaskell KM, Richardson M, Klein N, Garner P, MacPherson P. Discordant Immune Response with Antiretroviral Therapy in HIV-1: A Systematic Review of Clinical Outcomes. PLoS One. 2016;11(6):e0156099. pmid:27284683
View Article
PubMed/NCBI
Google Scholar

[26] View Article

[27] PubMed/NCBI

[28] Google Scholar

[ref8] 8. Adolescents PoAGfAa. Guidelines for the use of antiretroviral agents in HIV-1-infected adults and adolescents. Department of Health and Human Services. http://www.aidsinfo.nih.gov/ContentFiles/AdultandAdolescentGL.pdf [

[ref9] 9. Cenderello G, De Maria A. Discordant responses to cART in HIV-1 patients in the era of high potency antiretroviral drugs: clinical evaluation, classification, management prospects. Expert Rev Anti Infect Ther. 2016;14(1):29–40. pmid:26513236
View Article
PubMed/NCBI
Google Scholar

[31] View Article

[32] PubMed/NCBI

[33] Google Scholar

[ref10] 10. Achhra AC, Petoumenos K, Law MG. Relationship between CD4 cell count and serious long-term complications among HIV-positive individuals. Curr Opin HIV AIDS. 2014;9(1):63–71. pmid:24275674
View Article
PubMed/NCBI
Google Scholar

[35] View Article

[36] PubMed/NCBI

[37] Google Scholar

[ref11] 11. Lederman MM, Calabrese L, Funderburg NT, Clagett B, Medvik K, Bonilla H, et al. Immunologic failure despite suppressive antiretroviral therapy is related to activation and turnover of memory CD4 cells. J Infect Dis. 2011;204(8):1217–26. pmid:21917895
View Article
PubMed/NCBI
Google Scholar

[39] View Article

[40] PubMed/NCBI

[41] Google Scholar

[ref12] 12. Engsig FN, Zangerle R, Katsarou O, Dabis F, Reiss P, Gill J, et al. Long-term mortality in HIV-positive individuals virally suppressed for >3 years with incomplete CD4 recovery. Clin Infect Dis. 2014;58(9):1312–21. pmid:24457342
View Article
PubMed/NCBI
Google Scholar

[43] View Article

[44] PubMed/NCBI

[45] Google Scholar

[ref13] 13. Kaufmann GR, Furrer H, Ledergerber B, Perrin L, Opravil M, Vernazza P, et al. Characteristics, determinants, and clinical relevance of CD4 T cell recovery to <500 cells/microL in HIV type 1-infected individuals receiving potent antiretroviral therapy. Clin Infect Dis. 2005;41(3):361–72. pmid:16007534
View Article
PubMed/NCBI
Google Scholar

[47] View Article

[48] PubMed/NCBI

[49] Google Scholar

[ref14] 14. Gilson RJ, Man SL, Copas A, Rider A, Forsyth S, Hill T, et al. Discordant responses on starting highly active antiretroviral therapy: suboptimal CD4 increases despite early viral suppression in the UK Collaborative HIV Cohort (UK CHIC) Study. HIV Med. 2010;11(2):152–60. pmid:19732175
View Article
PubMed/NCBI
Google Scholar

[51] View Article

[52] PubMed/NCBI

[53] Google Scholar

[ref15] 15. Tan R, Westfall AO, Willig JH, Mugavero MJ, Saag MS, Kaslow RA, et al. Clinical outcome of HIV-infected antiretroviral-naive patients with discordant immunologic and virologic responses to highly active antiretroviral therapy. J Acquir Immune Defic Syndr. 2008;47(5):553–8. pmid:18285713
View Article
PubMed/NCBI
Google Scholar

[55] View Article

[56] PubMed/NCBI

[57] Google Scholar

[ref16] 16. Nicastri E, Chiesi A, Angeletti C, Sarmati L, Palmisano L, Geraci A, et al. Clinical outcome after 4 years follow-up of HIV-seropositive subjects with incomplete virologic or immunologic response to HAART. J Med Virol. 2005;76(2):153–60. pmid:15834865
View Article
PubMed/NCBI
Google Scholar

[59] View Article

[60] PubMed/NCBI

[61] Google Scholar

[ref17] 17. Grabar S, Le Moing V, Goujard C, Leport C, Kazatchkine MD, Costagliola D, et al. Clinical outcome of patients with HIV-1 infection according to immunologic and virologic response after 6 months of highly active antiretroviral therapy. Ann Intern Med. 2000;133(6):401–10. pmid:10975957
View Article
PubMed/NCBI
Google Scholar

[63] View Article

[64] PubMed/NCBI

[65] Google Scholar

[ref18] 18. Lewden C, Chene G, Morlat P, Raffi F, Dupon M, Dellamonica P, et al. HIV-infected adults with a CD4 cell count greater than 500 cells/mm3 on long-term combination antiretroviral therapy reach same mortality rates as the general population. J Acquir Immune Defic Syndr. 2007;46(1):72–7. pmid:17621240
View Article
PubMed/NCBI
Google Scholar

[67] View Article

[68] PubMed/NCBI

[69] Google Scholar

[ref19] 19. Rodger AJ, Lodwick R, Schechter M, Deeks S, Amin J, Gilson R, et al. Mortality in well controlled HIV in the continuous antiretroviral therapy arms of the SMART and ESPRIT trials compared with the general population. AIDS. 2013;27(6):973–9. pmid:23698063
View Article
PubMed/NCBI
Google Scholar

[71] View Article

[72] PubMed/NCBI

[73] Google Scholar

[ref20] 20. Lu W, Mehraj V, Vyboh K, Cao W, Li T, Routy JP. CD4:CD8 ratio as a frontier marker for clinical outcome, immune dysfunction and viral reservoir size in virologically suppressed HIV-positive patients. J Int AIDS Soc. 2015;18:20052. pmid:26130226
View Article
PubMed/NCBI
Google Scholar

[75] View Article

[76] PubMed/NCBI

[77] Google Scholar

[ref21] 21. Deeks SG. HIV infection, inflammation, immunosenescence, and aging. Annu Rev Med. 2011;62:141–55. pmid:21090961
View Article
PubMed/NCBI
Google Scholar

[79] View Article

[80] PubMed/NCBI

[81] Google Scholar

[ref22] 22. Lim H, Mondal P, Sinner S. Joint modeling of longitudinal and event time data: application to HIV study. Journal of Medical Statistics and Informatics 2013;1.
View Article
Google Scholar

[83] View Article

[84] Google Scholar

[ref23] 23. Wulfsohn MS, Tsiatis AA. A joint model for survival and longitudinal data measured with error. Biometrics. 1997;53(1):330–9. pmid:9147598
View Article
PubMed/NCBI
Google Scholar

[86] View Article

[87] PubMed/NCBI

[88] Google Scholar

[ref24] 24. Guest JL, Weintrob AC, Rimland D, Rentsch C, Bradley WP, Agan BK, et al. A comparison of HAART outcomes between the US military HIV Natural History Study (NHS) and HIV Atlanta Veterans Affairs Cohort Study (HAVACS). PLoS One. 2013;8(5):e62273. pmid:23658717
View Article
PubMed/NCBI
Google Scholar

[90] View Article

[91] PubMed/NCBI

[92] Google Scholar

[ref25] 25. Guest JL, Moanna A, Schlueter Wirtz S, Caruth EC, Rentsch C, Marconi VC, et al. Cohort Profile: The HIV Atlanta Veterans Affairs Cohort Study (HAVACS). Int J Epidemiol. 2017;46(5):1727. pmid:29025043
View Article
PubMed/NCBI
Google Scholar

[94] View Article

[95] PubMed/NCBI

[96] Google Scholar

[ref26] 26. Marconi VC, Grandits GA, Weintrob AC, Chun H, Landrum ML, Ganesan A, et al. Outcomes of highly active antiretroviral therapy in the context of universal access to healthcare: the U.S. Military HIV Natural History Study. AIDS Res Ther. 2010;7:14. pmid:20507622
View Article
PubMed/NCBI
Google Scholar

[98] View Article

[99] PubMed/NCBI

[100] Google Scholar

[ref27] 27. Colasanti J, Kelly J, Pennisi E, Hu YJ, Root C, Hughes D, et al. Continuous Retention and Viral Suppression Provide Further Insights Into the HIV Care Continuum Compared to the Cross-sectional HIV Care Cascade. Clin Infect Dis. 2016;62(5):648–54. pmid:26567263
View Article
PubMed/NCBI
Google Scholar

[102] View Article

[103] PubMed/NCBI

[104] Google Scholar

[ref28] 28. Zhang D, Chen MH, Ibrahim JG, Boye ME, Shen W. JMFit: A SAS Macro for Joint Models of Longitudinal and Survival Data. J Stat Softw. 2016;71(3). pmid:27616941
View Article
PubMed/NCBI
Google Scholar

[106] View Article

[107] PubMed/NCBI

[108] Google Scholar

[ref29] 29. Castilho JL, Shepherd BE, Koethe J, Turner M, Bebawy S, Logan J, et al. CD4+/CD8+ ratio, age, and risk of serious noncommunicable diseases in HIV-infected adults on antiretroviral therapy. AIDS. 2016;30(6):899–908. pmid:26959354
View Article
PubMed/NCBI
Google Scholar

[110] View Article

[111] PubMed/NCBI

[112] Google Scholar

[ref30] 30. Mussini C, Lorenzini P, Cozzi-Lepri A, Lapadula G, Marchetti G, Nicastri E, et al. CD4/CD8 ratio normalisation and non-AIDS-related events in individuals with HIV who achieve viral load suppression with antiretroviral therapy: an observational cohort study. Lancet HIV. 2015;2(3):e98–106. pmid:26424550
View Article
PubMed/NCBI
Google Scholar

[114] View Article

[115] PubMed/NCBI

[116] Google Scholar

[ref31] 31. Song X, Davidian M, Tsiatis AA. A semiparametric likelihood approach to joint modeling of longitudinal and time-to-event data. Biometrics. 2002;58(4):742–53. pmid:12495128
View Article
PubMed/NCBI
Google Scholar

[118] View Article

[119] PubMed/NCBI

[120] Google Scholar

[ref32] 32. Rizopoulos D. Dynamic predictions and prospective accuracy in joint models for longitudinal and time-to-event data. Biometrics. 2011;67(3):819–29. pmid:21306352
View Article
PubMed/NCBI
Google Scholar

[122] View Article

[123] PubMed/NCBI

[124] Google Scholar

[ref33] 33. Brombin C, Di Serio C, Rancoita PM. Joint modeling of HIV data in multicenter observational studies: A comparison among different approaches. Stat Methods Med Res. 2016;25(6):2472–87. pmid:24671658
View Article
PubMed/NCBI
Google Scholar

[126] View Article

[127] PubMed/NCBI

[128] Google Scholar

[ref34] 34. Viard JP, Mocroft A, Chiesi A, Kirk O, Roge B, Panos G, et al. Influence of age on CD4 cell recovery in human immunodeficiency virus-infected patients receiving highly active antiretroviral therapy: evidence from the EuroSIDA study. J Infect Dis. 2001;183(8):1290–4. pmid:11262215
View Article
PubMed/NCBI
Google Scholar

[130] View Article

[131] PubMed/NCBI

[132] Google Scholar

[ref35] 35. van Lelyveld SF, Gras L, Kesselring A, Zhang S, De Wolf F, Wensing AM, et al. Long-term complications in patients with poor immunological recovery despite virological successful HAART in Dutch ATHENA cohort. AIDS. 2012;26(4):465–74. pmid:22112603
View Article
PubMed/NCBI
Google Scholar

[134] View Article

[135] PubMed/NCBI

[136] Google Scholar

[ref36] 36. Altman DG, Royston P. The cost of dichotomising continuous variables. BMJ. 2006;332(7549):1080. pmid:16675816
View Article
PubMed/NCBI
Google Scholar

[138] View Article

[139] PubMed/NCBI

[140] Google Scholar

[ref37] 37. Royston P, Altman DG, Sauerbrei W. Dichotomizing continuous predictors in multiple regression: a bad idea. Stat Med. 2006;25(1):127–41. pmid:16217841
View Article
PubMed/NCBI
Google Scholar

[142] View Article

[143] PubMed/NCBI

[144] Google Scholar

[ref38] 38. Takuva S, Maskew M, Brennan AT, Long L, Sanne I, Fox MP. Poor CD4 recovery and risk of subsequent progression to AIDS or death despite viral suppression in a South African cohort. J Int AIDS Soc. 2014;17:18651. pmid:24594114
View Article
PubMed/NCBI
Google Scholar

[146] View Article

[147] PubMed/NCBI

[148] Google Scholar

[ref39] 39. Sax PE. Editorial commentary: can we break the habit of routine CD4 monitoring in HIV care? Clin Infect Dis. 2013;56(9):1344–6. pmid:23315314
View Article
PubMed/NCBI
Google Scholar

[150] View Article

[151] PubMed/NCBI

[152] Google Scholar

Figures

Abstract

Objectives

Methods

Results

Conclusions

Introduction

Methods

Study setting and population

Definitions

Institutional Review Board approval

Statistical analysis

Association analyses via CD4 modeling.

Association analyses via CD4/CD8 ratio modeling.

Comparison of CD4 count metrics.

Results

Patient characteristics

CD4 count and CD4/CD8 ratio characteristics

CD4 modeling

CD4 metrics comparison

Discussion

Supporting information

S1 Appendix. Supplementary methods.

S2 Appendix. SAS v9.4 code for conducting two-stage modeling and joint modeling analyses.

S3 Appendix. INR definitions in the literature.

S2 Table. Association of estimated CD4/CD8 ratio slope and intercept during the two years following ART initiation with risk of composite endpoint.

S3 Table. Association between patient CD4 recovery status based on estimated CD4 slope and risk of composite endpoint by baseline age group, gender and race.

S4 Table. Association between patient CD4/CD8 ratio recovery status based on estimated CD4/CD8 ratio slope and risk of composite endpoint by baseline age group, gender and race.

S5 Table. Comparison of Uno’s C-statistics among the four prognostic risk factors: (i) Estimated CD4 slope (ii) Estimated CD4/CD8 ratio slope (iii) CD4 counts after 1 year and (iv) CD4 counts after 2 years.

S1 Fig.

S2 Fig.

Acknowledgments

References