Figures
Abstract
Background
HIV-1 RNA plasma concentration at viral set-point is associated not only with disease outcome but also with the transmission dynamics of HIV-1. We investigated whether plasma HIV-1 RNA concentration and CD4 cell count at viral set-point have changed over time in the HIV epidemic in the Netherlands.
Methodology/Principal Findings
We selected 906 therapy-naïve patients with at least one plasma HIV-1 RNA concentration measured 9 to 27 months after estimated seroconversion. Changes in HIV-1 RNA and CD4 cell count at viral set-point over time were analysed using linear regression models. The ATHENA national observational cohort contributed all patients who seroconverted in or after 1996; the Amsterdam Cohort Studies (ACS) contributed seroconverters before 1996. The mean of the first HIV-1 RNA concentration measured 9–27 months after seroconversion was 4.30 log10 copies/ml (95% CI 4.17–4.42) for seroconverters from 1984 through 1995 (n = 163); 4.27 (4.16–4.37) for seroconverters 1996–2002 (n = 232), and 4.59 (4.52–4.66) for seroconverters 2003–2007 (n = 511). Compared to patients seroconverting between 2003–2007, the adjusted mean HIV-1 RNA concentration at set-point was 0.28 log10 copies/ml (95% CI 0.16–0.40; p<0.0001) and 0.26 (0.11–0.41; p = 0.0006) lower for those seroconverting between 1996–2002 and 1984–1995, respectively. Results were robust regardless of type of HIV-1 RNA assay, HIV-1 subtype, and interval between measurement and seroconversion. CD4 cell count at viral set-point declined over calendar time at approximately 5 cells/mm3/year.
Conclusion
The HIV-1 RNA plasma concentration at viral set-point has increased over the last decade of the HIV epidemic in the Netherlands. This is accompanied by a decreasing CD4 cell count over the period 1984–2007 and may have implications for both the course of the HIV infection and the epidemic.
Citation: Gras L, Jurriaans S, Bakker M, van Sighem A, Bezemer D, Fraser C, et al. (2009) Viral Load Levels Measured at Set-Point Have Risen Over the Last Decade of the HIV Epidemic in the Netherlands. PLoS ONE 4(10): e7365. https://doi.org/10.1371/journal.pone.0007365
Editor: Nitika Pant Pai, McGill University Health Center, Montreal Chest Institute, Canada
Received: June 18, 2009; Accepted: September 6, 2009; Published: October 7, 2009
Copyright: © 2009 Gras et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The ATHENA cohort is supported by a grant from the Dutch Health Minister and was set up and is maintained by the Stichting HIV Monitoring. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
During the asymptomatic phase of HIV-1 infection, virus production and clearance are believed to reach a balance reflecting a relatively stable level of HIV-1 RNA concentration in plasma. Whether this balance, or viral set-point, is reached in all patients remains open to debate [1], [2]. It is agreed, however, that with a higher HIV-1 RNA plasma level, progression to AIDS is more frequent [3], as is the rate of HIV-1 transmission [4]. A rising trend over time in plasma HIV-1 RNA concentration at set-point might imply an increase in the efficiency of transmission [5], [6]. Three observational studies found no evidence for such a change [7]–[9], whereas two studies did [10], [11]. Contrasting results likewise come from studies of HIV-1 RNA replicative fitness at viral set-point, thought to be positively correlated with HIV-1 RNA concentration in plasma [12], [13]. One study suggested a lower replicative fitness in HIV-1 isolates obtained from patients infected in 2002–2003 compared to isolates from patients infected between 1986–1999 [14], but samples were not matched for time since seroconversion. A similar study, using isolates obtained from participants of the Amsterdam Cohort Study and samples matched for time since seroconversion, found an increase in replicative fitness over time [15].
Here we present a study of changes in the mean HIV-1 RNA concentration and CD4 cell count at viral set-point measured in patients who became seropositive between 1984 and 2007.
Results
Baseline characteristics of the included 906 patients are summarized in Table 1. CD4 cell counts were available for 811 (90%). Of the 906 total, 92% were male, 76% had homosexual contact recorded as the most likely transmission route, and 82% originated from W-Europe/N-America. Most patients from other regions of origin were from S-America/Caribbean. Only 2% were from sub-Sahara Africa.
Results of HIV-1 subtyping, using nucleotide sequences of the pol region obtained for HIV-1 drug-resistance testing, were available for 449 (50%) patients, and subtype B was found in 408 (91%). Infection with circulating recombinant form (CRF) 02_AG was found in 15 patients, CRF 01_AE in 8, subtype A in 5, subtype C in 5, subtype G in 4, subtype D in 2, subtype A1 in 1 and CRF 03_AB in 1 patient. Of 425 patients tested before antiretroviral therapy was started, 32 (7.5%) had at least one resistance mutation.
In all 163 patients with seroconversion before 1996, the HIV-1 RNA concentration at set-point was measured with assays using the NASBA technique. Overall, RT-PCR was most used (in 40% of the 906 total). HIV-1 RNA plasma concentrations measured at set-point were below the lower quantitation limit of the assay used in 37 of 906 (4%) patients. In 19 patients (2%), HIV-1 RNA concentrations were above the upper quantitation limit of the assay used.
The mean HIV-1 RNA concentration at set-point in all 906 patients was 4.45 log10 copies/ml. It was 4.30, 4.27, and 4.59 log10 copies/ml in patients with an estimated seroconversion date between 1984–1995, 1996–2002, and 2003–2007, respectively. Table 2 shows the differences in mean HIV-1 RNA concentration according to estimated year of seroconversion, as obtained with unadjusted and adjusted regression models. Compared to patients with an estimated seroconversion date in or after 2003, the adjusted mean HIV-1 RNA concentration among patients seroconverting between 1996 and 2002 and before 1996 was lower by 0.29 log10 copies/ml (95% CI 0.16–0.41; p<0.0001) and 0.27 (0.12–0.42; p = 0.0004), respectively. Furthermore, the adjusted mean HIV-1 RNA concentration at set-point was 0.32 (95% CI 0.12–0.51) log10 copies/ml lower in women compared to men (p = 0.002). Patients infected with subtype B had on average a 0.40 (0.14–0.67) log10 copies/ml higher HIV-1 RNA concentration (p = 0.003) than patients infected with non-B subtypes. The mean HIV-1 RNA concentration was 0.16 (0.00–0.32) log10 copies/ml higher in patients from W-Europe/N-America compared to patients from elsewhere (p = 0.04). There were no significant differences in mean HIV-1 RNA concentration according to age at seroconversion (p = 0.43), HIV transmission group (p = 0.95), interval between seroconversion and viral set-point (p = 0.96), or presence of a resistance mutation (p = 0.92).
To test whether the increase in viral set-point could reflect changing use of various quantitative HIV-1 RNA assays over time, we added type of assay to the model. The differences in mean HIV-1 RNA concentration between different periods of seroconversion increased slightly (Table 2). Relative to seroconverters between 2003 and 2007, the mean HIV-1 RNA concentration was 0.31 log10 copies/ml (95% CI 0.18–0.44; p<0.0001) lower for seroconverters between 1996 and 2002 and 0.40 (0.18–0.63; p = 0.0003) lower for those seroconverting before 1996. The difference in HIV-1 RNA concentration measured with RT-PCR assays was on average −0.12 log10 copies/ml (95% CI −0.30, 0.07; p = 0.21) compared to NASBA assays and 0.04 (−0.09, 0.17; p = 0.54) compared to bDNA assays. The HIV-1 RNA concentration was on average 0.16 log10 copies/ml (−0.03, 0.35; p = 0.10) higher when measured with the NASBA technique compared to samples tested with assays using bDNA. HIV-1 RNA concentration measured using assays with a lower detection limit ≤400 copies/ml was 0.08 log10 copies (95% CI −0.24, 0.08; p = 0.33) lower than those measured using assays with a higher detection limit. However, the differences according to calendar year of seroconversion remained similar. Also, when analyses were stratified according to the type or sensitivity of the assay, results remained similar (results not shown).
Given scarce data on HCV or HBV co-infection in patients who seroconverted before 1996, we restricted analyses including such co-infections as a confounder to the 743 patients who seroconverted in or after 1996. Mean HIV-1 RNA concentration in patients with a HCV co-infection was 0.36 log10 copies/ml (95% CI 0.08–0.64, p = 0.01) higher than in patients without a HCV co-infection. It was 0.09 log10 copies/ml (−0.16−0.35, p = 0.46) higher in patients with a HBV co-infection compared to patients without. Differences in mean HIV-1 RNA concentration according to year of HIV-1 seroconversion remained similar, being 0.29 log10 copies/ml (0.17–0.41, p<0.0001) higher in patients with seroconversion between 2003–2007 compared to 1996–2002.
To avoid any bias arising from changes in the distribution of ethnicity, gender, and infection with non-B subtype over time, we focused on a homogeneous patient group of 612 MSM from W-Europe/N-America. Patients with a confirmed HIV-1 non-B infection were excluded. Figure 1 shows the HIV-1 RNA concentration at set-point and at 12, 18, and 24 months after seroconversion and the estimated mean HIV-1 RNA concentration by calendar year of seroconversion. The dashed line in Figure 1a shows that the mean set-point HIV-1 RNA concentration at the start of 1985 was 4.46 log10 copies/ml (95% CI 4.27–4.65). It was 4.21 log10 copies/ml (4.09–4.33) at its lowest value in 1995 and 4.88 log10 copies/ml (4.76–5.01) in 2007. Estimates of differences in mean HIV-1 RNA concentration at set-point according to the calendar year of seroconversion for this subgroup, shown in Table 2, are similar to those for the total of 906 patients. HIV-1 subtype was the only variable included in the adjusted model apart from estimated year of seroconversion. On further restricting the sample size to the 297 patients known to be infected with subtype B, we found similar differences in mean HIV-1 RNA concentration (results not shown). Finally, we looked separately at plasma HIV-1 RNA levels at 12, 18, and 24 months after seroconversion and found mean HIV-1 RNA concentrations of 4.50, 4.48, and 4.40 log10 copies/ml, respectively. Differences in mean HIV-1 RNA concentration at 12 and 18 months according to estimated year of seroconversion were similar to those obtained through models including the first HIV-1 RNA concentration between 9 and 27 months after seroconversion. In a final sensitivity analysis, including 751 patients with a maximum seroconversion interval of 6 months, the mean of the first HIV-1 RNA concentration taken after seroconversion was 0.48 log10 copies/ml (95% CI 0.26–0.71; p<0.0001) lower for seroconverters before 1996 and 0.17 (0.00–0.35; p = 0.05) lower between 1996–2002 compared to 2003–2007. The mean was 0.31 log10 copies/ml (0.06–0.56; p = 0.02) lower for seroconverters before 1996 compared to 1996–2002.
In MSM patients from W-Europe or N-America with a proven or likely infection with subtype B: a) first HIV-1 RNA 9–27 months after seroconversion (n = 612), b) at 12 (n = 552), c) 18 (n = 370), and d) 24 months (n = 315). The solid black line shows the mean HIV-1 RNA concentration for patients with an estimated date of seroconversion from 1984 through 1995, 1996 through 2002, and 2003 through 2007 (as shown in Table 2). Dashed black lines are estimates obtained by continuous modelling of the estimated date of seroconversion using cubic splines.
In 811 patients with CD4 cell counts available between 9–27 months after seroconversion, the median count at viral set-point was 520 cells/mm3 (IQR 390–680). Table 3 shows results of the linear regressions of CD4 cell count at viral set-point. Mean CD4 cell count at viral set-point declined throughout the period 1984–2007 by 0.025 cube root cells/mm3/year (95% CI 0.012, 0.038; p<0.0001), a decline of approximately 5 CD4 cells/mm3/year. Region of origin was the only other variable included in the adjusted model. Mean CD4 cell count at viral set-point in patients from W-Europe/N-America with seroconversion between 2003–2007 was 507 cells/mm3 (485–530), compared to 466 cells/mm3 (425–509, difference p = 0.07) for patients from elsewhere. Table 3 shows results of regression analyses of CD4 cell count on a cube-root scale for our homogeneous patient group. The mean decrease over time of the first CD4 cell count 9–27 months after seroconversion and at 12, 18, and 24 months after seroconversion was 0.028 (95% CI 0.014, 0.041), 0.025 (0.011, 0.038), 0.027 (0.013, 0.041), and 0.021 (0.004, 0.038) cubic root cells/mm3/year, respectively. Figure 2 shows the estimates back-transformed to the original scale. Mean CD4 count at 12 months was 592 (562–653), 563 (523–605) and 502 cells/mm3 (479–527) for seroconverters between 1984–1995, 1996–2002, and 2003–2007, respectively. Estimated differences in CD4 count between seroconverters of 1996–2002 and 2003–2007 were greater in analyses of the homogeneous patients than in analyses of the total group.
In MSM from W-Europe/N-America with a proven or likely subtype B infection: a) first CD4 cell count between 9 and 27 months after seroconversion (n = 578), b) at 12 months (n = 555), c) 18 months (n = 439), and d) 24 months (n = 347). The solid black line shows the mean CD4 cell count for patients with an estimated date of seroconversion from 1984 through 1995, 1996 through 2002, and 2003 through 2007 (as shown in Table 2). The dashed black lines were obtained using linear models assuming a constant decrease between 1984 and 2007.
Discussion
We found a rising trend over time in the HIV-1 RNA concentration at set-point in patients infected in the last decade, with a complementary downward trend in CD4 cell count at viral set-point.
Our results agree with those of the CASCADE study [10] and a recent study of the epidemic in Italy [11]. The CASCADE study found an increase in mean HIV-1 RNA concentration at viral set-point of 0.035 log10 copies/ml/year over the period 1985–2002, although we found an increase only from 1996. Three other studies found no evidence for an increase [7]–[9]. Differences in patient selection, study period, and outcome definitions across these five studies might explain the discrepancies. In a study from the Swiss HIV Cohort Study (SHCS) and the Italian cohort study [8], [11], all patients with a confirmed HIV-1 infection were selected. Other studies restricted patient selection to seroconverters with a maximum seroconversion interval of 6 months [9] or 12 months [7], [10]. Herbeck et al. [7] looked at HIV-1 RNA concentration at set-point in 384 homosexual patients with known seroconversion dates between 1985 and 2005, but most were infected before 1996. The study period in that study and the SHCS [8] might have been too short to find an increase in HIV-1 RNA concentration at set-point over time. Outcome definitions of the five studies ranged from the first available measurement of HIV-1 RNA plasma concentration after seroconversion [9], [10] to measurements at a later stage [7], [8], [11]. Because the exact moment of seroconversion is unknown, the former definition has the disadvantage of not knowing whether the measurement was taken during the peak HIV RNA concentration phase following infection, during the phase shortly before or after the peak, or during the set-point phase. This type of measurement error most likely hampers the detection of significant changes over time. Admittedly, using measurements at a later stage can introduce bias, because patients who have started antiretroviral therapy early are censored from the analysis. Assuming that patients with a high HIV-1 RNA concentration and a low CD4 cell count will start therapy earlier than patients with a lower concentration and a higher cell count, results may be biased towards a lower HIV-1 RNA concentration and higher CD4 cell count at viral set-point from 1996 onwards, especially in measurements taken 24 months after seroconversion. This may explain our finding of a significant difference between patients who seroconverted before 1996 and those who did so between 1996 and 2002 with respect to the first HIV-1 RNA concentration after seroconversion and no significant difference when analysing the first HIV-1 RNA concentration taken 9–27 months after seroconversion. However, both analyses showed an increasing HIV-1 RNA concentration over time.
The decreasing trend in CD4 cell count at viral set-point over time complements the increasing trend in HIV-1 RNA concentration. A similar decrease in CD4 cell count over time was likewise found in other studies [10], [16], [17]. Evidence of an increasing trend [18] or a stable level [7], [19] in CD4 cell count might reflect a shorter study period.
Bias through systematic inclusion of correlated transmission networks is unlikely, as active enrolment of related partners was never in place during our entire study period. Other potential sources of bias which could have influenced our finding include the genetic heterogeneity of HIV-1, which can impede the accuracy of quantitation, especially in early assays primarily designed to detect subtype B [20]–[22]. However, the effect persisted when we focused on a homogeneous group of MSM from W-Europe/N-America with a proven or highly likely subtype B infection. The higher mean HIV-1 RNA concentration in patients for whom we lacked subtype data points to some residual confounding because of infection with non-B subtypes. However, sensitivity analyses of patients known to be infected with subtype B found similar differences in mean HIV-1 RNA concentration at set-point over time.
Disease progression has been shown to differ among patients with subtype A, C, D and G infection [23]–[25]. We found a higher mean HIV RNA concentration in patients with subtype B infection compared to non-B, as well as in patients from W-Europe/N-America compared to those with other origins. A recent study reported a higher set-point virus load in patients with white ethnicity compared to black (mostly from sub-Sahara Africa), but no significant differences between infection with B and non-B subtypes [26]. Differences in the distribution of ethnicity and subtypes might explain this discrepancy.
Since only 30 of the 830 men we studied were infected through heterosexual contact, lack of power might have been a reason we found a non-significant difference in HIV RNA concentration at set-point between MSM and heterosexually infected patients. The SHCS reported a significant difference between MSM and heterosexually infected patients [8]. Also in contrast to the SHCS, our study and others found a higher HIV RNA concentration at set-point in female patients. The difference in HIV RNA concentration between men and women emerges only at lower CD4 cell counts [27], a factor that could explain these different results.
The HIV-1 RNA plasma concentration was measured with several assays. The distribution of the assays used has changed over the years, and we did not perform batch-wise re-testing of samples using only one assay. HIV-1 RNA concentrations measured within the dynamic range of the Versant HIV-1 RNA (bDNA) 3.0 assay are, on average, lower than those measured with the Cobas Amplicor assay (RT-PCR) [28]–[30]. The Amplicor HIV-1 Monitor assay (RT-PCR) [31] yields, on average, lower concentrations than the NASBA HIV-1 RNA QT assay, the only assay used in samples taken before 1996. This ranking was reflected in our analyses and might explain the more pronounced differences after adjusting for type of assay between seroconverters from 1984–1995 and from 2003–2007. In concordance with previous reports, the mean HIV-1 RNA concentration at set-point was slightly higher when measured using assays with a lower detection limit of 1000 or 400 copies/ml compared to ≤50 copies/ml [32], but adjustment for assay sensitivity did not appreciably change our results. The changing distribution of assays is thus unlikely to explain the increase in mean HIV-1 RNA concentration at viral set-point over time.
Techniques for measuring CD4 cell counts changed over time as well, leading to less test variability. Absolute CD4 cell counts were traditionally assessed using a dual-platform technique that has been gradually replaced by a single-platform technique introduced in the late 1990s. Others changes in flow cytometry techniques over time include changes in the gating strategy and sample preparation. There is some evidence to suggest that CD4 cell counts turn out lower when measured using the single-platform technique. Also, CD45-SSC gating, more frequently used in later calendar years, may yield higher CD4 cell counts than CD45-CD14 gating, more frequently used in earlier calendar years [33]. For our study, these two potential biases may outweigh each other.
In samples obtained before 1996, quantitation followed storage at −80°C. No significant effect of freezing, storage, and thawing on HIV RNA recovery using the Amplicor HIV-1 Monitor and NASBA HIV-1 RNA QT assay has been reported [31], [34], [35]. Moreover, we observed an increase in mean HIV-1 RNA concentration at set-point between periods 1996–2002 and 2003–2007.
The awareness level of physicians and patients to symptoms of acute HIV-1 infection has improved in recent years and could have influenced our findings. Set-point HIV-1 RNA concentration has been shown to increase with the number of symptoms after recent HIV-1 infection [36], [37]. In times when patients without symptoms were overlooked, the mean HIV-1 RNA concentration at set-point was most likely overestimated. However, as data on symptoms were not collected, we could not investigate this further.
The increasing number of patients included in our study over time positively correlated with increasing set-point viral load levels. The contribution of resulting selection of higher viral load at set-point in to facilitating the spread of HIV is a cause for alarm. However, other reasons for the higher number of study patients in more recent years include more sexual risk behaviour [38], [39], more HIV-negative subjects who repeatedly test for sexually transmitted infections (STIs) [39]–[41], and a higher incidence of STIs [42]. Also, the start in 2003 of a randomized study of patients with primary HIV-1 infection has raised physician awareness. Therefore, the higher number of new infections in recent years included in our study cannot be ascribed solely to a higher set-point viral load in those years. As for the other possibility, an ongoing phylogenetic study has found no indications that newly imported HIV-1 strains are responsible for the changes in set-point HIV RNA levels.
Some evidence suggests that HIV-1 RNA concentration at viral set-point is an adaptive trait and may change under the influence of selection [6]. Transmission of HIV-1 is thought to happen most efficiently very early, during primary infection, and late, during the symptomatic phase [4], [43]. During the asymptomatic phase after primary infection, the probability of transmission may be smaller, but given the long duration of this phase, its contribution to the number of newly infected patients is probably substantial. Successful antiretroviral therapy, usually started some years after primary infection, suppresses HIV-1 RNA plasma concentration to levels at which the probability of transmission is considered minimal. Thus the period of infectiousness may largely be confined to the very early phase of infection, in which viruses that reproduce at a high level are selected. Such viruses could establish a high HIV-1 RNA concentration at set-point in a new host [44]. For this hypothesis to hold, set-point viral load between transmitter and recipient needs to be correlated. This correlation will be investigated in a future study, using data from transmission networks.
A significant increase in HIV-1 replication fitness over time has been described for the Amsterdam epidemic [15]. Follow-up molecular analysis should reveal which changes in the viral components are responsible for this increased replication capacity. An increase in HIV RNA concentration at set-point may be also the result of adaptation of HIV to particular HLA molecules in the population. Kawashima et al. show that HLA molecules associated in 1983 with slow disease progression did not protect against disease progression in Japanese patients infected between 1997–2008 [45].
In conclusion, we found an increase in the HIV-1 RNA plasma concentration measured at viral set-point and a decrease in CD4 cell count in non-treated patients with a confirmed HIV-1 seroconversion during the last decade of the HIV epidemic in the Netherlands. The higher HIV-1 RNA concentration could not be attributed to changes in subtype or assay used, but coincides with a higher proportion of treated HIV-1-infected patients. The implications of an increased HIV-1 RNA concentration at viral set-point on disease progression and on transmission dynamics require further study.
Methods
Patient selection
The ATHENA observational cohort [46] includes anonomyzed data from all HIV- infected patients living in the Netherlands who receive care in one of the 24 HIV treatment centres. Initially, data were collected only from patients who had started combination antiretroviral therapy (cART). Data collection was extended in 2002 to include all HIV-infected patients, cART treated or untreated alike, who had been followed since 1996 in any of the centres. ATHENA patients are informed by their treating physician of an opt-out procedure. Ethical approval is not obtained, as data collection is part of HIV care. For our study, we also included data obtained from homosexual men (MSM) participating in the Amsterdam Cohort Studies (ACS) [47]. Informed written consent is obtained from all ACS participants, and the ACS has been approved by the Medical Ethical Committee of the Academic Medical Centre.
We selected patients with a maximum interval of one year between the last negative and first positive HIV-1 antibody test. The day of seroconversion was estimated as the midpoint between the last seronegative and the first seropositive test. Patients with negative or indeterminate Western Blot results in the presence of HIV-1 p24 anitigen or RNA were also selected, in which case the day of seroconversion was set one month prior to the date of the first positive antibody test. All patients in our study were at least 16 years old at the estimated day of seroconversion, had been sampled at least once for plasma HIV-1 RNA concentration between 9 and 27 months after seroconversion, and were antiretroviral therapy-naive. All patients who seroconverted before 1996 were participants of the ACS.
Measurements
First, we used the HIV-1 RNA concentration and CD4 cell count measured in peripheral blood sampled earliest in the 9–27 months after seroconversion as the measurements at viral set-point. In addition, we selected results of the HIV-1 RNA and CD4 cell count measurements taken between 9 and 15 months (closest to 12), between 15 and 21 months (closest to 18), and between 21 and 27 months (closest to 24). Any measurements taken after the start of antiretroviral therapy were not used in any analysis. Assays were classified according to the amplification technique: nucleic acid sequence-based amplification (NASBA), reverse transcriptase-polymerase chain reaction (RT-PCR), and branched DNA signal amplification (bDNA). Assays using the NASBA technique were NASBA HIV-1 RNA QT, NucliSens HIV-1 RNA QT, and NucliSens EasyQ (bioMérieux, Boxtel, The Netherlands). Assays using RT-PCR techniques were Amplicor HIV-1 Monitor, Cobas Amplicor, Cobas TaqMan HIV-1 (Roche Diagnostics, Pleasanton, CA, USA), LCx HIV RNA quantitative, and m2000rt HIV RNA (Abbott, Abbott Park, IL, USA). The only assay using the bDNA technique was Versant HIV-1 RNA version 3.0 (Siemens, Deerfield, IL, USA). Classification by amplification technique is very similar to classification by manufacturer. The RT-PCR assays made by Roche and Abbott were grouped together. Since the Abbott assay was used in only 59 patients who all seroconverted in 2006 and 2007 these assays could not be analysed separately. Finally, HIV-1 RNA assays were also classified as standard (having a lower detection limit of 1000 or 400 copies/ml) and sensitive (having a lower detection limit ≤50 copies/ml).
Statistical analysis
Parametric survival regression models with a normal error distribution were used to model changes in plasma HIV-1 RNA concentration at set-point. When below the limit of detection, the value was regarded as interval-censored between 1 copy/ml and the lower detection limit. Values above the upper detection limit were right-censored at the upper detection limit. CD4 cell count at viral set-point was modelled using linear regression models. CD4 cell counts were cube root-transformed to apply better to model assumptions. Estimated calendar year of seroconversion was modelled using 3 categories: <1996 (pre-cART), 1996–2002 and ≥2003. The post-cART cut-off was chosen so that each time period was sufficiently wide and included a sufficient number of patients. Estimated date of seroconversion was continuously modelled using restricted cubic splines with knots at the 5th, 50th and 95th percentiles. This allowed us to model date of seroconversion in a flexible manner and to avoid having to report results over year categories with few patients. Splines with 5 knots were also used but led to similar estimates. Potential confounders for analysis of HIV-1 RNA concentration at set-point included gender, region of origin (W-Europe/N-America, other, and unknown), age at seroconversion, HIV-1 subtype (B, non-B, and unknown), transmission of drug-resistant virus (at least one mutation, none, and unknown) [48], interval between measurement and seroconversion, transmission risk group (men having sex with men [MSM], heterosexual, intravenous drug use [IDU], other, and unknown), co-infection with HBV of HCV (positive, negative, or unknown), sensitivity of assay (lower detection limit ≥400 and <400 copies/ml), and technique of the quantitative HIV-1 RNA assay used (NASBA, RT-PCR, and bDNA). Active HBV co-infection was defined as a positive HBsAg test. Chronic HCV co-infection was defined as a positive HCV RNA test or, if not available, a positive HCV antibody test. We used the first available test result up to 2 years after the estimated HIV-1 seroconversion date. Variables were retained in adjusted models if their overall p-value was <0.20.
To obtain results in a population as homogeneous as possible, we also ran models including only data from MSM from W-Europe/N-America. Patients with a proven HIV-1 non-B infection were excluded. If the HIV-1 subtype was not determined, patients were included. In addition, we performed sensitivity analyses on patients with a confirmed subtype B infection. A final sensitivity analysis was performed on patients with a maximum seroconversion interval of 6 months, using the first HIV-1 RNA measurement after seroconversion as dependent variable. This analysis was performed in order to study the potential bias that results from censoring patients with an early start of antiretroviral therapy. Models were adjusted for time between the estimated day of seroconversion and the measurement using restricted cubic splines.
Analyses were performed using SAS version 9.1 (SAS Institute, Cary, North Carolina, USA).
Acknowledgments
We thank Angélique van 't Wout, Hanneke Schuitemaker and Marijke Roos for their helpful suggestions and Lucy Phillips for editing the manuscript. The ATHENA national observational cohort has been made possible through the collaborative efforts of the following physicians (*site coordinating physicians): Academisch Medisch Centrum bij de Universiteit van Amsterdam - Amsterdam: Dr. J.M. Prins*, Drs. J.C. Bos, Dr. J.K.M. Eeftinck-Schattenkerk, Dr. S.E. Geerlings, Dr. M.H. Godfried, Prof. dr. J.M.A. Lange, Dr. J.T.M. van der Meer, Dr. F.J.B. Nellen, Drs. D.P. Olszyna, Dr. T. van der Poll, Prof. dr. P. Reiss, Drs. S.U.C. Sankatsing, Drs. R. Steingrover, Drs. M. van der Valk, Drs. J.N. Vermeulen, Drs. S.M.E. Vrouenraets, Dr. M. van Vugt, Dr. F.W.M.N. Wit. Academisch Ziekenhuis Maastricht - Maastricht: Dr. G. Schreij*, Dr. S. van der Geest, Dr. A. Oude Lashof, Dr. S. Lowe, Dr. A. Verbon. Catharina Ziekenhuis - Eindhoven: Dr. B. Bravenboer*, Drs. M.J.H. Pronk. Emma Kinderziekenhuis - AMC Amsterdam: Prof. dr. T.W. Kuijpers, Drs. D. Pajkrt, Dr. H.J. Scherpbier. Erasmus MC - Rotterdam: Dr. M.E. van der Ende*, Drs. H. Bax, Drs. M. van der Feltz, Dr. L.B.S. Gelinck, Drs. Mendoca de Melo (until September 1, 2008), Dr. J.L. Nouwen, Dr. B.J.A. Rijnders, Dr. E.D. de Ruiter, Dr. L. Slobbe, Drs. C.A.M. Schurink, Dr. T.E.M.S. de Vries. Erasmus MC - Sophia - Rotterdam: Dr. G. Driessen, Dr. M. van der Flier, Dr. N.G. Hartwig. Flevoziekenhuis - Almere: Dr. J. Branger. Haga Ziekenhuis, locatie Leyenburg - Den Haag: Dr. R.H. Kauffmann*, Drs. K. Pogány (until August 1, 2008), Dr. E.F. Schippers (from May 1, 2008). Isala Klinieken - Zwolle: Dr. P.H.P. Groeneveld*, Dr. M.A. Alleman. Kennemer Gasthuis - Haarlem: Prof. dr. R.W. ten Kate*, Dr. R. Soetekouw. Leids Universitair Medisch Centrum - Leiden: Dr. F.P. Kroon*, Dr. S.M. Arend, Drs. M.G.J. de Boer, Prof. dr. P.J. van den Broek, Prof. dr. J.T. van Dissel, Drs. C. van Nieuwkoop. Maasstadziekenhuis - locatie Clara - Rotterdam: Dr. J.G. den Hollander*. Medisch Centrum Alkmaar - Alkmaar: Dr. W. Bronsveld*. Medisch Centrum Haaglanden -locatie Westeinde - Den Haag: Dr. R. Vriesendorp*, Dr. F.J.F. Jeurissen, Dr. E.M.S. Leyten. Medisch Centrum Leeuwarden - Leeuwarden: Dr. D. van Houte*, Dr. M.B. Polée. Medisch Spectrum Twente - Enschede: Dr. C.H.H. ten Napel*, Dr. G.J. Kootstra. Onze Lieve Vrouwe Gasthuis – Amsterdam: Prof. dr. K. Brinkman*, Drs. G.E.L. van den Berk, Dr. W.L. Blok, Dr. P.H.J. Frissen, Drs. W.E.M. Schouten. St. Medisch Centrum Jan van Goyen - Amsterdam: Dr. A. van Eeden*, Dr. D.W.M. Verhagen. Slotervaart Ziekenhuis - Amsterdam: Dr. J.W. Mulder*, Dr. E.C.M. van Gorp, Dr. A.T.A. Mairuhu, Drs. R. Steingrover, Dr. J. Wagenaar. St. Elisabeth Ziekenhuis - Tilburg: Dr. J.R. Juttmann*, Dr. M.E.E. van Kasteren. St. Lucas Andreas Ziekenhuis - Amsterdam: Dr. J. Veenstra*, Dr. W.L.E. Vasmel. Universitair Medisch Centrum St. Radboud - Nijmegen: Dr. P.P. Koopmans*, Drs. A.M. Brouwer, Dr. A.S.M. Dofferhoff, Prof. dr. R. de Groot, Drs. H.J.M. ter Hofstede, Dr. M. Keuter, Dr. A.J.A.M. van der Ven. Universitair Medisch Centrum Groningen - Groningen: Dr. H.G. Sprenger*, Dr. S. van Assen, Dr. J.T.M. van Leeuwen, Dr. C.J. Stek. Universitair Medisch Centrum Groningen - Beatrix Kliniek - Groningen: Dr. R. Doedens, Dr. E.H. Scholvinck. Universitair Medisch Centrum Utrecht - Utrecht: Prof. dr. I.M. Hoepelman*, Dr. M.M.E. Schneider, Prof. dr. M.J.M. Bonten, Dr. P.M. Ellerbroek, Drs. C.A.J.J. Jaspers, Drs. L.J. Maarschalk-Ellerbroek, Dr. J.J. Oosterheert, Dr. E.J.G. Peters, Dr. T. Mudrikova, Drs. M.W.M. Wassenberg, Dr. S. Weijer. Wilhelmina Kinderziekenhuis - UMC Utrecht: Dr. S.P.M. Geelen, Dr. T.F.W. Wolfs. VU Medisch Centrum - Amsterdam: Prof. dr. S.A. Danner*, Dr. M.A. van Agtmael, Drs. W.F.W. Bierman, Drs. F.A.P. Claessen, Drs. M.E. Hillebrand, Drs. E.V. de Jong, Drs. W. Kortmann, Dr. R.M. Perenboom, Drs. E.A. bij de Vaate. Ziekenhuis Rijnstate - Arnhem: Dr. C. Richter*, Drs. J. van der Berg, Dr. E.H. Gisolf. Ziekenhuis Walcheren - Vlissingen: Dr. A.A. Tanis*. St. Elisabeth Hospitaal/Stichting Rode Kruis Bloedbank - Willemstad, Curaçao: Dr. A.J. Duits, Dr. K. Winkel. Virologists: Academisch Medisch Centrum bij de Universiteit van Amsterdam – Amsterdam: Dr. N.K.T. Back, Dr. M.E.G. Bakker, Dr. H.L. Zaaijer.Prof. dr. B. Berkhout, Dr. S. Jurriaans. CLB Stichting Sanquin Bloedvoorziening -Amsterdam: Dr. Th. Cuijpers.Onze Lieve Vrouwe Gasthuis - Amsterdam: Dr. P.J.G.M. Rietra, Dr. K.J. Roozendaal. Slotervaart Ziekenhuis - Amsterdam: Drs. W. Pauw, Drs. P.H.M. Smits, Dr. A.P. van Zanten. VU Medisch Centrum – Amsterdam: Dr. B.M.E. von Blomberg, Dr. A. Pettersson, Dr. P. Savelkoul; Ziekenhuis Rijnstate – Arnhem:Dr. C.M.A. Swanink. HAGA, ziekenhuis, locatie Leyenburg - Den Haag: Dr. P.F.H. Franck, Dr. A.S. Lampe. Medisch Centrum Haaglanden, locatie Westeinde - Den Haag: Drs. C.L. Jansen.; Streeklaboratorium Twente - Enschede: Dr. R. Hendriks. Streeklaboratorium Groningen - Groningen: Dr. C.A. Benne;.Streeklaboratorium Volksgezondheid Kennemerland - Haarlem: Dr. J. Schirm, Dr. D. Veenendaal. Laboratorium voor de Volksgezondheid in Friesland - Leeuwarden: Dr. H. Storm, Drs. J. Weel, Drs. J.H. van Zeijl; Leids Universitair Medisch Centrum - Leiden: Dr. H.C.J. Claas, Prof. dr. A.C.M. Kroes. Academisch Ziekenhuis Maastricht - Maastricht: Prof. dr. C.A.M.V.A. Bruggeman, Drs. V.J. Goossens. Universitair Medisch Centrum St. Radboud - Nijmegen: Prof. dr. J.M.D. Galama, Dr. W.J.G. Melchers, Dr. Verduyn-Lunel. Erasmus MC - Rotterdam: Dr. G.J.J. van Doornum, Dr. H.G.M. Niesters, Prof. dr. A.D.M.E. Osterhaus, Dr. M. Schutten.St. Elisabeth Ziekenhuis - Tilburg: Dr. A.G.M. Buiting. Universitair Medisch Centrum Utrecht - Utrecht: Dr. C.A.B. Boucher, Dr. E. Boel, Dr. R. Schuurman. Catharina Ziekenhuis - Eindhoven: Dr. A.F. Jansz, drs. M. Wulf. Pharmacologists: Medisch Centrum Alkmaar - Alkmaar: Dr. A. Veldkamp. Slotervaart Ziekenhuis - Amsterdam: Prof. dr. J.H. Beijnen, Dr. A.D.R. Huitema. Universitair Medisch Centrum St. Radboud - Nijmegen: Dr. D.M.Burger. Academisch Medisch Centrum bij de Universiteit van Amsterdam – Amsterdam: Drs. H.J.M. van Kan.
Author Contributions
Conceived and designed the experiments: LG FdW. Analyzed the data: LG. Wrote the paper: LG DB FdW. Commented on the paper: SJ MB AvS DB CF JML JP BB. Gave advice on data analysis: SJ MB AvS DB CF FdW.
References
- 1. Geskus RB, Prins M, Hubert JB, Miedema F, Berkhout B, et al. (2007) The HIV RNA setpoint theory revisited. Retrovirology 4: 65.
- 2. de Wolf F, Spijkerman I, Schellekens PT, Langendam M, Kuiken C, et al. (1997) AIDS prognosis based on HIV-1 RNA, CD4+ T-cell count and function: Markers with reciprocal predictive value over time after seroconversion. Aids 11: 1799–1806.
- 3. Mellors JW, Munoz A, Giorgi JV, Margolick JB, Tassoni CJ, et al. (1997) Plasma viral load and CD4+ lymphocytes as prognostic markers of HIV-1 infection. Ann Intern Med 126: 946–954.
- 4. Wawer MJ, Gray RH, Sewankambo NK, Serwadda D, Li X, et al. (2005) Rates of HIV-1 transmission per coital act, by stage of HIV-1 infection, in Rakai, Uganda. J Infect Dis 191: 1403–1409.
- 5. Quinn TC, Wawer MJ, Sewankambo N, Serwadda D, Li C, et al. (2000) Viral load and heterosexual transmission of human immunodeficiency virus type 1. Rakai Project Study Group. N Engl J Med 342: 921–929.
- 6. Fraser C, Hollingsworth TD, Chapman R, de Wolf F, Hanage WP (2007) Variation in HIV-1 set-point viral load: epidemiological analysis and an evolutionary hypothesis. Proc Natl Acad Sci U S A 104: 17441–17446.
- 7. Herbeck JT, Gottlieb GS, Li X, Hu Z, Detels R, et al. (2008) Lack of Evidence for Changing Virulence of HIV-1 in North America. PLoS ONE 3: e1525.
- 8. Muller V, Ledergerber B, Perrin L, Klimkait T, Furrer H, et al. (2006) Stable virulence levels in the HIV epidemic of Switzerland over two decades. Aids 20: 889–894.
- 9. Troude P, Chaix ML, Tran L, Deveau C, Seng R, et al. (2009) No evidence of a change in HIV-1 virulence since 1996 in France. Aids 23: 1261–1267. 10.1097/QAD.0b013e32832b51ef [doi].
- 10. Dorrucci M, Rezza G, Porter K, Phillips A (2007) Temporal trends in postseroconversion CD4 cell count and HIV load: the Concerted Action on Seroconversion to AIDS and Death in Europe Collaboration, 1985–2002. J Infect Dis 195: 525–534.
- 11. Muller V, Maggiolo F, Suter F, Ladisa N, De Luca A, et al. (2009) Increasing clinical virulence in two decades of the Italian HIV epidemic. PLoS Pathog 5: e1000454.
- 12. Troyer RM, Collins KR, Abraha A, Fraundorf E, Moore DM, et al. (2005) Changes in human immunodeficiency virus type 1 fitness and genetic diversity during disease progression. J Virol 79: 9006–9018.
- 13. Quinones-Mateu ME, Ball SC, Marozsan AJ, Torre VS, Albright JL, et al. (2000) A dual infection/competition assay shows a correlation between ex vivo human immunodeficiency virus type 1 fitness and disease progression. J Virol 74: 9222–9233.
- 14. Arien KK, Troyer RM, Gali Y, Colebunders RL, Arts EJ, et al. (2005) Replicative fitness of historical and recent HIV-1 isolates suggests HIV-1 attenuation over time. Aids 19: 1555–1564.
- 15. Gali Y, Berkhout B, Vanham G, Bakker M, Back NK, et al. (2007) Survey of the temporal changes in HIV-1 replicative fitness in the Amsterdam Cohort. Virology 364: 140–146.
- 16. Dorrucci M, Phillips AN, Longo B, Rezza G (2005) Changes over time in post-seroconversion CD4 cell counts in the Italian HIV-Seroconversion Study: 1985–2002. Aids 19: 331–335.
- 17. Crum-Cianflone N, Eberly L, Zhang Y, Ganesan A, Weintrob A, et al. (2009) Is HIV becoming more virulent? Initial CD4 cell counts among HIV seroconverters during the course of the HIV epidemic: 1985–2007. Clin Infect Dis 48: 1285–1292.
- 18. Keet IP, Veugelers PJ, Koot M, de Weerd MH, Roos MT, et al. (1996) Temporal trends of the natural history of HIV-1 infection following seroconversion between 1984 and 1993. Aids 10: 1601–1602.
- 19. Galai N, Lepri AC, Vlahov D, Pezzotti P, Sinicco A, et al. (1996) Temporal trends of initial CD4 cell counts following human immunodeficiency virus seroconversion in Italy, 1985–1992. The Human Immunodeficiency Virus Italian Seroconversion Study. Am J Epidemiol 143: 278–282.
- 20. Swanson P, Holzmayer V, Huang S, Hay P, Adebiyi A, et al. (2006) Performance of the automated Abbott RealTime HIV-1 assay on a genetically diverse panel of specimens from London: comparison to VERSANT HIV-1 RNA 3.0, AMPLICOR HIV-1 MONITOR v1.5, and LCx HIV RNA Quantitative assays. J Virol Methods 137: 184–192.
- 21. Pasquier C, Sandres K, Salama G, Puel J, Izopet J (1999) Using RT-PCR and bDNA assays to measure non-clade B HIV-1 subtype RNA. J Virol Methods 81: 123–129.
- 22. Elbeik T, Alvord WG, Trichavaroj R, de Souza M, Dewar R, et al. (2002) Comparative analysis of HIV-1 viral load assays on subtype quantification: Bayer Versant HIV-1 RNA 3.0 versus Roche Amplicor HIV-1 Monitor version 1.5. J Acquir Immune Defic Syndr 29: 330–339.
- 23. Kanki PJ, Hamel DJ, Sankale JL, Hsieh C, Thior I, et al. (1999) Human immunodeficiency virus type 1 subtypes differ in disease progression. J Infect Dis 179: 68–73. JID980530 [pii];10.1086/314557 [doi].
- 24. Kiwanuka N, Laeyendecker O, Robb M, Kigozi G, Arroyo M, et al. (2008) Effect of human immunodeficiency virus Type 1 (HIV-1) subtype on disease progression in persons from Rakai, Uganda, with incident HIV-1 infection. J Infect Dis 197: 707–713. 10.1086/527416 [doi].
- 25. Vasan A, Renjifo B, Hertzmark E, Chaplin B, Msamanga G, et al. (2006) Different rates of disease progression of HIV type 1 infection in Tanzania based on infecting subtype. Clin Infect Dis 42: 843–852. CID37432 [pii];10.1086/499952 [doi].
- 26. Muller V, von Wyl V, Yerly S, Boni J, Klimkait T, Burgisser P, et al. (2009) African descent is associated with slower CD4 cell count decline in treatment-naive patients of the Swiss HIV Cohort Study. Aids 23: 1269–1276. 10.1097/QAD.0b013e32832d4096 [doi].
- 27. Donnelly CA, Bartley LM, Ghani AC, Le Fevre AM, Kwong GP, et al. (2005) Gender difference in HIV-1 RNA viral loads. HIV Med 6: 170–178.
- 28. Galli R, Merrick L, Friesenhahn M, Ziermann R (2005) Comprehensive comparison of the VERSANT HIV-1 RNA 3.0 (bDNA) and COBAS AMPLICOR HIV-1 MONITOR 1.5 assays on 1,000 clinical specimens. J Clin Virol 34: 245–252.
- 29. Murphy DG, Cote L, Fauvel M, Rene P, Vincelette J (2000) Multicenter comparison of Roche COBAS AMPLICOR MONITOR version 1.5, Organon Teknika NucliSens QT with Extractor, and Bayer Quantiplex version 3.0 for quantification of human immunodeficiency virus type 1 RNA in plasma. J Clin Microbiol 38: 4034–4041.
- 30. Berger A, Scherzed L, Sturmer M, Preiser W, Doerr HW, et al. (2005) Comparative evaluation of the Cobas Amplicor HIV-1 Monitor Ultrasensitive Test, the new Cobas AmpliPrep/Cobas Amplicor HIV-1 Monitor Ultrasensitive Test and the Versant HIV RNA 3.0 assays for quantitation of HIV-1 RNA in plasma samples. J Clin Virol 33: 43–51.
- 31. Griffith BP, Rigsby MO, Garner RB, Gordon MM, Chacko TM (1997) Comparison of the Amplicor HIV-1 monitor test and the nucleic acid sequence-based amplification assay for quantitation of human immunodeficiency virus RNA in plasma, serum, and plasma subjected to freeze-thaw cycles. J Clin Microbiol 35: 3288–3291.
- 32. Notermans DW, de Wolf F, Oudshoorn P, Cuijpers HT, Pirillo M, et al. (2000) Evaluation of a second-generation nucleic acid sequence-based amplification assay for quantification of HIV type 1 RNA and the use of ultrasensitive protocol adaptations. AIDS Res Hum Retroviruses 16: 1507–1517.
- 33. Levering WH, van Wieringen WN, Kraan J, van Beers WA, Sintnicolaas K, et al. (2008) Flow cytometric lymphocyte subset enumeration: 10 years of external quality assessment in the Benelux countries. Cytometry B Clin Cytom 74: 79–90. 10.1002/cyto.b.20370 [doi].
- 34. Ginocchio CC, Wang XP, Kaplan MH, Mulligan G, Witt D, et al. (1997) Effects of specimen collection, processing, and storage conditions on stability of human immunodeficiency virus type 1 RNA levels in plasma. J Clin Microbiol 35: 2886–2893.
- 35. Bruisten SM, Oudshoorn P, van Swieten P, Boeser-Nunnink B, van Aarle P, et al. (1997) Stability of HIV-1 RNA in blood during specimen handling and storage prior to amplification by NASBA-QT. J Virol Methods 67: 199–207.
- 36. Kelley CF, Barbour JD, Hecht FM (2007) The relation between symptoms, viral load, and viral load set point in primary HIV infection. J Acquir Immune Defic Syndr 45: 445–448.
- 37. Branger J, van der Meer JT, van Ketel RJ, Jurriaans S, Prins JM (2008) High Incidence of Asymptomatic Syphilis in HIV-Infected MSM Justifies Routine Screening. Sex Transm Dis.
- 38. Stolte IG, Dukers NH, Geskus RB, Coutinho RA, de Wit JB (2004) Homosexual men change to risky sex when perceiving less threat of HIV/AIDS since availability of highly active antiretroviral therapy: a longitudinal study. Aids 18: 303–309.
- 39. Heijman RL, Stolte IG, Thiesbrummel HF, van Leent E, Coutinho RA, et al. (2009) Opting out increases HIV testing in a large sexually transmitted infections outpatient clinic. Sex Transm Infect 85: 249–255. sti.2008.033258 [pii];10.1136/sti.2008.033258 [doi].
- 40. Koedijk FDH, Vriend HJ, van Veen MG, Op de Coul ELM, van den Broek IVF, et al. (2009) Sexually transmitted infections, including HIV, in the Netherlands in 2008. RIVM report 210261004/2008.
- 41. Dukers-Muijrers NH, Niekamp AM, Vergoossen MM, Hoebe CJ (2009) Effectiveness of an opting-out strategy for HIV testing: evaluation of 4 years of standard HIV testing in a STI clinic. Sex Transm Infect 85: 226–230. sti.2008.033191 [pii];10.1136/sti.2008.033191 [doi].
- 42. Stolte IG, Dukers NH, de Wit JB, Fennema JS, Coutinho RA (2001) Increase in sexually transmitted infections among homosexual men in Amsterdam in relation to HAART. Sex Transm Infect 77: 184–186.
- 43. Hollingsworth TD, Anderson RM, Fraser C (2008) HIV-1 transmission, by stage of infection. J Infect Dis 198: 687–693.
- 44. Tang J, Tang S, Lobashevsky E, Zulu I, Aldrovandi G, et al. (2004) HLA allele sharing and HIV type 1 viremia in seroconverting Zambians with known transmitting partners. AIDS Res Hum Retroviruses 20: 19–25.
- 45. Kawashima Y, Pfafferott K, Frater J, Matthews P, Payne R, et al. (2009) Adaptation of HIV-1 to human leukocyte antigen class I. Nature 458: 641–645. nature07746 [pii];10.1038/nature07746 [doi].
- 46. Gras L, van Sighem A, Smit C, Zaheri S, Schuitemaker H, et al. (2008) Monitoring of Human Immunodeficiency Virus (HIV) Infection in the Netherlands
- 47. van Griensven GJ, Tielman RA, Goudsmit J, van der Noordaa J, de Wolf F, et al. (1987) Risk factors and prevalence of HIV antibodies in homosexual men in the Netherlands. Am J Epidemiol 125: 1048–1057.
- 48. Johnson VA, Brun-Vezinet F, Clotet B, Gunthard HF, Kuritzkes DR, et al. (2008) Update of the Drug Resistance Mutations in HIV-1: Spring 2008. Top HIV Med 16: 62–68.