To understand geographic variations in clinical retention, a central component of the HIV care continuum and key to improving individual- and population-level HIV outcomes.
Adults receiving care from 2000–2010 in 12 clinical cohorts of the North American AIDS Cohort Collaboration on Research and Design (NA-ACCORD) contributed data. Individuals were assigned to Centers for Disease Control and Prevention (CDC)-defined regions by residential data (10 cohorts) and clinic location as proxy (2 cohorts). Retention was ≥2 primary HIV outpatient visits within a calendar year, >90 days apart. Trends and regional differences were analyzed using modified Poisson regression with clustering, adjusting for time in care, age, sex, race/ethnicity, and HIV risk, and stratified by baseline CD4+ count.
Among 78,993 adults with 444,212 person-years of follow-up, median time in care was 7 years (Interquartile Range: 4–9). Retention increased from 2000 to 2010: from 73% (5,000/6,875) to 85% (7,189/8,462) in the Northeast, 75% (1,778/2,356) to 87% (1,630/1,880) in the Midwest, 68% (8,451/12,417) to 80% (9,892/12,304) in the South, and 68% (5,147/7,520) to 72% (6,401/8,895) in the West. In adjusted analyses, retention improved over time in all regions (p<0.01, trend), although the average percent retained lagged in the West and South vs. the Northeast (p<0.01).
Citation: Rebeiro PF, Gange SJ, Horberg MA, Abraham AG, Napravnik S, Samji H, et al. (2016) Geographic Variations in Retention in Care among HIV-Infected Adults in the United States. PLoS ONE 11(1): e0146119. https://doi.org/10.1371/journal.pone.0146119
Editor: Matthew P. Fox, Boston University, UNITED STATES
Received: July 31, 2015; Accepted: December 14, 2015; Published: January 11, 2016
Copyright: © 2016 Rebeiro et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data are from the NA-ACCORD cohort collaboration of IeDEA (International epidemiologic Databases to Evaluate AIDS), whose authors may be contacted at http://statepiaps.jhsph.edu/naaccord/Collaboration/index.html. A concept sheet must be submitted, reviewed, and approved by the Executive and Steering Committees of NA-ACCORD before data access/data sharing are allowed. This is a requirement of all participating cohort IRB approvals, as well as the study umbrella IRB approval from the Johns Hopkins University School of Medicine, ensuring secure, timely, and ethical sharing of the cohort's data. Due to ethical restrictions, data are available upon request. The NA-ACCORD’s data practices have been outlined in the literature (http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2820873/). Interested researchers may submit requests for data to the project manager, who will direct the collaborative process through the Administrative, Data Management, and Epidemiology/Biostatistics Cores (email@example.com).
Funding: This work was supported by grants U01-AI069918, U01-AA013566, U24-AA020794, U01-AA020790, U01-AI31834, U01-AI34989, U01-AI34993, U01-AI34994, U01-AI35004, U01-AI35039, U01-AI35040, U01-AI35041, U01-AI35042, U01-AI35043, U01-AI37613, U01-AI37984, U01-AI38855, U01-AI38858, U01-AI42590, U01-AI68634, U01-AI68636, U01-AI69432, U01-AI69434, U01-HD32632, U10-EY08057, U10-EY08052, U10- EY08067, UL1-RR024131, UL1-TR000083, U54- MD007587, F31-DA035713, G12- MD007583, K01-AI071754, K01-AI093197, K23 EY013707, K24-AI065298, K24-00432, MO1-RR-00052, N02-CP55504, P30-AI027763, P30-AI094189, P30-AI27757, P30-AI27767, P30-AI50410, P30-AI54999, P30-AI036219, P30-MH62246, R01-CA165937, R01-AA16893, R01-DA11602, U01-DA0356935, R01-DA04334, R01-DA12568, R24-AI067039, R56-AI102622, Z01-CP010214, and Z01-CP010176 from the National Institutes of Health, USA; contract CDC200-2006-18797 from the Center's for Disease Control and Prevention, USA; contract 90047713 from the Agency for Healthcare Research and Quality, USA; contract 90051652 from the Health Resources and Services Administration, USA; grants TGF-96118, HCP-97105, CBR-86906, CBR-94036 from the Canadian Institutes of Health Research, Canada; Ontario Ministry of Health and Long Term Care; and the Government of Alberta, Canada.
Competing interests: The authors have declared that no competing interests exist.
Mapping health outcomes and identifying geographic variations in care are useful tools in public health, assisting decision-makers in identifying locales in greatest need of resources.[1–7] The field of HIV epidemiology has been no exception, and analyses of geographic variation in HIV incidence, extent, severity, and intervention effectiveness have yielded insights into the changing nature and trajectory of the pandemic.[8–16] In the U.S., HIV prevalence, incidence, disease progression, treatment, and mortality have been noted to differ across geographic regions and individual states.[17–21]
Retention in care is associated with improved access to antiretroviral therapy (ART), greater likelihood of virologic suppression, and less rapid HIV disease progression.[22–27] Similarly, the same demographic, clinical, and socioeconomic factors (i.e., younger age, Black race, higher CD4 count, and unstable housing status) have been repeatedly associated with suboptimal retention in various contexts. However, these analyses have rarely focused on geographic heterogeneity as a potential source of clinical retention differences and have incorporated these data by adjusting for clinic site in multi-site analyses or examining relatively small numbers of jurisdictions.[28–39] Further, some of the studies in which these patterns of retention were discerned may have cohort-specific traits which could affect clinic attendance such as state Medicaid funding levels or local social stigmas (e.g., a history of intolerance toward sexual minorities) that could limit their external generalizability to persons living with HIV/AIDS (PLWHA) in the U.S. Nevertheless, recent major policy initiatives, including the National HIV/AIDS Strategy (NHAS), have identified improving clinical retention, and targeting impediments to these improvements, as goals central to improving outcomes across the HIV Care Continuum in the U.S.[40–43]
Yet retention in care requires consistent and ongoing interaction with the healthcare system, a process which may include various obstacles which differ geographically (due to demographic, economic, risk behavior, political, and cultural factors).[9,20,21,35,44] In consideration of these issues, our aim was to describe the geography of clinical care experience over time in order to provide evidence for evaluating benchmarks of national HIV policy goals and to better understand factors that are pertinent to public health interventions designed to improve retention in HIV care. We therefore quantified the geographic heterogeneity of retention between 2000 and 2010 within a large and geographically diverse HIV cohort that is demographically similar to PLWHA in the U.S.
Population and study design
The North American AIDS Cohort Collaboration on Research and Design (NA-ACCORD) represents the United States and Canada in the International epidemiologic Databases to Evaluate AIDS (IeDEA) project. The NA-ACCORD began collecting data from multi- and single-site interval and clinical cohorts in 2006. The Institute of Medicine of the National Academies (IOM) has promulgated the NA-ACCORD, due to its size and demographic similarity with PLWHA in the U.S., as one of 12 data systems appropriate to assess quality of care goals, such as improving clinical retention, in the NHAS and Affordable Care Act  Details of the data collection and submission process for the NA-ACCORD have been published previously. Briefly, clinical, demographic, and geographic data from 25 cohorts are transmitted to a centrally-administered Data Management Core annually where all contributed data are harmonized. Data undergo quality control for completeness and accuracy, including measures to reduce the probability that an individual was concurrently participating in more than one clinical cohort. The activities of the NA-ACCORD and each of its participating cohorts have been reviewed and approved by their respective local institutional review boards and by the Johns Hopkins School of Medicine institutional review board. Written consent was either obtained individually, or else waivers of individual consent were obtained through each site’s respective local institutional review board. All data were de-identified prior to analysis.
Among clinical cohorts, only patients with ≥ 2 HIV primary care visits within 12 months were enrolled into the NA-ACCORD, limiting the NA-ACCORD population to patients successfully linked to and established as “in care” proximal to cohort entry.[24,26]
Adult participants who had ≥ 1 HIV primary care visit between January 2000 and December 2010 were included in this longitudinal, retrospective cohort study. Classic prospective cohorts were excluded to allow an exclusive focus on patterns of patient clinical care in clinical cohorts. Canadian cohorts were also excluded. The 12 included clinical cohorts were comprised of patients from all 50 U.S. states, Washington, D.C., and Puerto Rico, 818 of 887 US 3-digit ZIP Code Tabulation Areas (ZCTA), and 167 clinical sites located in areas of dense population across the country.
Our nested study was reviewed by the Johns Hopkins Bloomberg School of Public Health institutional review board, and it was deemed non-human-subject/non-research because it was a secondary analysis of existing, anonymized/de-identified data.
Retention measures, factors associated with retention, and follow-up
The outcome for our analysis was clinical retention in care (“retention”), defined using the IOM indicator: ≥ 2 HIV primary care visits within a calendar year, ≥ 90 days apart. This measure was used because it is the same as that adopted in the National HIV/AIDS Strategy. We have previously evaluated the strong agreement of this indicator with DHHS indicators and with laboratory proxies.[25,48] Only HIV primary care encounters were used to define retention. Other outpatient encounter types, including subspecialty care, emergency department, dental, mental health, nursing, nutrition, orientation, pharmacy, social work/case manager, substance abuse, and other/unknown outpatient encounters, were not used for these analyses. Inpatient visits and laboratory only visits were also excluded.
Participant age (<40, 40–49, 50–59, and ≥60 years), sex, race/ethnicity (White, Black, Hispanic, or other/unknown), HIV acquisition risk factor (male sexual contact with men (MSM), injection drug use [IDU], heterosexual contact, or other/unknown), receipt of ART for ≥6 months in a year (≥3 antiretroviral drugs from ≥2 classes, or a triple nucleoside/nucleotide reverse transcriptase inhibitor (NRTI) regimen containing abacavir or tenofovir), first CD4+ cell count during each year of follow-up, last HIV-1 RNA measure during each year of follow-up, and geographic location of residence (US Centers for Disease Control (CDC)-defined region, state, and 3-digit ZCTA) were included in analyses of factors by which clinical retention may have differed. The composition of regions by state is described below.
ART receipt and CD4+ cell count were used in secondary analyses as baseline covariates for stratification indicating health status and access to care at cohort enrollment; HIV-1 RNA was excluded from regression analyses due to its putative role as time-dependent confounder in the longitudinal relationship between demographic and HIV risk characteristics and retention. Geographic location of patient residence was collected at cohort entry and was not allowed to vary over time due to limited availability of residential movement data over the study period.
Individual data were summarized into one observation per year between 2000 (at the earliest) and the final encounter prior to the end of 2010. The initial year of care was excluded if the patient entered in the final quarter of a calendar year (and were thus ineligible to be “retained” in their year of entry). Year of death during the study period was excluded from analyses due to individuals not being uniformly “at risk” for successful retention in that year. Follow-up time ranged between 1 and 11 person-years, and individuals contributed multiple outcomes while under observation.
Additional geographic information
Location of patient residence by ZCTA was collected by individual clinical cohorts. Data consistency checks were performed to ensure that ZCTA of residence corresponded correctly with state of residence (as ZCTAs may be aggregated to the state-level along coterminous boundaries). State of residence was used to assign patients to geographic regions of the U.S. based on CDC and US Census Bureau definitions. US CDC-defined regions were: Northeast: CT, ME, MA, NH, NJ, NY, PA, RI, VT; Midwest: IL, IN, IA, KS, MI, MN, MO, NE, ND, OH, SD, WI; South: AL, AR, DE, DC, FL, GA, KY, LA, MD, MS, NC, OK, SC, TN, TX, VA, WV; and West: AK, AZ, CA, CO, HI, ID, MT, NV, NM, OR, UT, WA, WY. Demographic, geographic, and economic characteristics of ZCTAs were derived from 2000 and 2010 US decennial census estimates and assigned as follows: for years 2000–2003: from the 2000 census; for years 2008–2010: from the 2010 census; and for years 2004–2007: mid-point estimates between census years 2000 and 2010. Census-derived population-level variables included median age within the ZCTA and proportions of the ZCTA that were of female sex, of Black race, residing in a rural area, and living below the Federal poverty level. Rural areas and the poverty level were defined according to US Census Bureau standards. For ZCTA-level analyses, individual characteristics from NA-ACCORD participants were aggregated to the ZCTA level as median age in the sample, and the proportion of the sample that were of female sex, of Black race, and that had IDU as an HIV risk factor within the ZCTA.
For participants from 2 clinical cohorts (N = 35,131) whose residential data was unavailable, clinic location was used as a proxy for state of residence, but not for ZCTA; individuals from these cohorts were included in descriptions and analyses of regional and state-level differences in retention but not in analyses using ZCTA-level data.
Statistical models and methods
Regional differences in the percentage of patients clinically retained within strata of demographic and clinical characteristics were detected by χ2 test. Modified Poisson regression using a Generalized Estimating Equation (GEE) was used to assess temporal trends and determine the relative risks (RR) and 95% confidence intervals (CI) of retention based on demographic and geographic factors at the individual level. An unstructured working correlation was used for repeated outcomes within individuals in the GEE regression.[52,53] Time during the study period (i.e., study year) was included in models as a restricted cubic spline with 3 knots (at 2, 6, and 10 years) and as a categorical term for predictive margins. All individual-level models were also adjusted for total time contribution to the study (to account for possible cohort effects) and for contributing cohort site (to account for potential clinical practice differences). All proportions at the ZCTA level were mean-centered to ease interpretation in logistic regression modeling using GEE. In secondary analyses, the relationship between baseline CD4+ count and ART use with retention were assessed to explore regional differences in retention trajectories by initial access to care and late diagnosis. Interaction terms for region-by-baseline factors were included with the full Poisson regression model used in primary analyses at the individual level. Missing baseline CD4+ counts were multiply imputed using a predictive mean model regression including baseline age, sex, race/ethnicity, HIV risk factor, ART use, and cohort site.
Population-averaged effects are generally viewed as more germane to policy decisions, and there is evidence that mixed effects approaches may induce bias in this context.[56,57] Thus, the population-averaged model was employed here. ZCTA-level differences in proportions retained were also explored using logistic regression with GEE, adjusting for aggregated individual and ZCTA-level census characteristics.[58,59] Additional details of Poisson and logistic regression models with GEE at the individual and ZCTA levels, respectively, are available in the Appendix (S1 File). Maps were generated using ArcGIS version 10.1 (Environmental Systems Research Institute, Redlands, CA) and statistical analyses were performed using Stata version 12.1 (StataCorp, College Station, TX).
Among 78,993 adults with 444,212 person-years of follow-up, the median time in care was 7 (Interquartile Range: 4–9) years. The Midwest sample had the smallest percentage of regional prevalent HIV cases with 3.7% (3,583/97,711); the West had the highest percentage with 7.5% (12,037/159,523), using CDC data for prevalent HIV cases from 2009 as the denominator (the last year in which all 12 clinical cohorts contributed data). There were significant differences between US geographic regions in the percentage of person-time retained for each demographic and clinical characteristic evaluated (Table 1).
The percentage of individuals successfully retained increased from 2000 to 2010 in each region: from 73% (5,000/6,875) to 85% (7,189/8,462) in the Northeast, 75% (1,778/2,356) to 87% (1,630/1,880) in the Midwest, 68% (8,451/12,417) to 80% (9,892/12,304) in the South, and 68% (5,147/7,520) to 72% (6,401/8,895) in the West (Fig 1).
Diamonds are National HIV/AIDS Strategy/Institute of Medicine retention indicator percentages (≥2 visits in a calendar year, >90 days apart). Circles are Predictive Margins for the Probability of Being Retained by IOM indicator using a Region-by-Time interaction effect (Fully Adjusted Logistic Model with GEE) U.S. Centers for Disease Control and Prevention (CDC)-defined Regions: Northeast: CT, ME, MA, NH, NJ, NY, PA, RI, VT; Midwest: IL, IN, IA, KS, MI, MN, MO, NE, ND, OH, SD, WI; South: AL, AR, DE, DC, FL, GA, KY, LA, MD, MS, NC, OK, SC, TN, TX, VA, WV; West: AK, AZ, CA, CO, HI, ID, MT, NV, NM, OR, UT, WA, WY.
In adjusted regression models, there was a trend for improved retention over time (p<0.01) for all regions. Over the study period, the probability of retention was lower in the West (Risk Ratio (RR): 0.94; 95% Confidence Interval (CI): 0.92–0.95) and South (RR: 0.94; 95% CI: 0.93–0.95), and no different in the Midwest (RR: 1.02; 95% CI: 1.00–1.05), compared to the Northeast (p<0.01). Other factors including younger age, male sex, Black race, and IDU and Heterosexual contact as HIV acquisition risk factors were significantly associated with a decreased likelihood of retention (Fig 2).
Results from modified Poisson regression model using a Generalized Estimating Equation and adjusting for total time in care.
We found significant effect modification for racial differences in retention by region, in which the risk of retention among Black patients was poorer relative to White patients in the South than in other regions (RR: 0.94; 95% CI: 0.93–0.96, for Black vs. White patients in the South vs. the Northeast). We also found significant associations of baseline CD4+ count with retention within the Northeast, South, and West. However, the association in the Northeast (RR: 1.03 for both 200–349 and for ≥500 vs. <200 cells/μL; p = 0.02 each) was in the opposite direction of the relationship in the South and West (higher baseline CD4+ count was associated with between 3 and 6% decreased probability of retention vs. <200 cells/μL; p≤0.01 each, Table A in S1 File). Further, receipt of ART at baseline was associated with between 22 and 30% increased probability of retention within each region (p<0.01 each, Table A in S1 File). In each of these secondary analyses, the magnitude, direction, and significance of the associations between age group, sex, race, HIV risk factor, geographic region and retention were similar to those in the primary analysis (data not shown). Though state-level patterns generally conformed to the regional patterns observed (Southern and Western states lagged in observed and predicted retention probabilities over time), adjusting for state in the full model did not improve the model fit considerably. (Part F of Fig A in S1 File).
In models at the ZCTA-level, only an increase in median age (Odds Ratio (OR): 1.10 per year; 95% CI: 1.09–1.11) and a decrease in the census-based proportion of a ZCTA that were of Black race (OR: 0.36 per percentage difference increase from the mean proportion; 95% CI: 0.15–0.87) were significantly associated with improved retention (Table 2).
We found that among PLWHA successfully linked to and enrolled in care, the percentage of patients who were retained in care improved over time for all regions, with 72–87% retained in care in 2010. Despite this finding, the South and West exhibited lower retention levels over time compared to the Northeast. The results regarding the South are of particular concern in that they are troublingly consistent with surveillance and prior studies showing worse HIV outcomes, and significant sex and race disparities in these outcomes, compared to the rest of the U.S.[17,19–22] In the South, with its history of poorer educational performance, poorer access to healthcare than much of the rest of the country, and regressive policies with respect to racial/ethnic and sexual minorities, the lag in improved quality of care outcomes could be the product of several forces.[17,18,21] A geographically dispersed epidemic with residents of more rural areas who have longer commutes to clinic locations in primarily urban centers could affect the observed outcomes. Social stressors and structural factors that may limit the ability of individuals to access care (e.g., poverty, housing instability, discrimination, etc.) may also play an outsize role in the observed disparity of care between the South and Northeast, as noted in prior work. However, further research will be required to explore the role of these factors in clinical care in this patient population.
Despite regional disparities, however, the improvement in retention adds further evidence to earlier research that showed increasing percentages of large linked and clinically-engaged populations being retained over long periods of follow-up in the U.S.[39,45,48] Notably, this upward trend persisted, even after adjusting for demographic, geographic, and HIV risk factor differences, and after accounting for differential contributions of time at risk for leaving care. This may have been due to increased attention to clinical retention during the study period or to increasing numbers of individuals placed on ART,[18,45] requiring increased engagement between patient and providers. Examining retention patterns by CD4+ count at cohort entry, a marker of delayed diagnosis or linkage to care, the South and West again exhibited decreased retention compared to the Northeast, though by similar magnitudes regardless of CD4+ stratum. This indicates that CD4+ count at entry to care did not significantly influence differences in retention over time between patients in the Northeast, South, and West, even though baseline CD4+ count differed between patients subsequently retained and not retained across the US.[38,39] Though this appears to bode well for efforts to improve retention among all presenters for HIV care, it remains a powerful indication that even among patients linked to care early in infection, there may remain structural factors that are region-specific which may dominate patients’ subsequent experiences of care.
Regarding ART use at cohort entry, an indicator of access to care, a fairly strong positive association between ART use and retention regardless of region may indicate the power of personal experience in engaging with healthcare services. This may include improved self-efficacy among patients and motivation to maintain contact with care providers once personally invested in their own medical care through ART use. However, it may also be the case that clinician decisions on initiating or continuing therapy favor patients more likely to improve their retention in care or those who have demonstrated stability in their clinic visit patterns (e.g., delaying ART initiation in IDU patients if they are actively using). This does contradict reports of widespread clinician willingness to initiate therapy early in care among high risk patients, though in the largest such survey of clinician attitudes, the surveys were conducted only in New York and Washington, D.C.
Many of the same groups that have been previously identified with suboptimal retention in care and inferior HIV outcomes in general, again emerged in this analysis. These groups include: younger individuals, Black patients, and those with IDU as HIV risk factor.[29,32,62–64] Even though the unadjusted retention rates among these groups approaches the NHAS goal of 80% (among Ryan White clients), there is room for improvement when compared to other HIV-infected sub-populations. Given those deficits, and the fact that risk networks, culture, and socioeconomics may differ across regions, states, and more granular geographic levels, the identification of locales that may benefit most from interventions to improve healthcare quality, access, and retention remains as important as ever. Clinicians and public health practitioners should note that though vulnerable and high burden groups identified again here may be obvious targets for interventions to improve access to and retention in care, their deficits may differ by region, and a “one size fits all” approach at the national (and perhaps even the regional) level may not be warranted. It may even be the case that simply expanding the use of ART at entry to care may improve patient engagement and retention. Further analysis will be required to isolate the potential effects of individual clinical decision-making before concluding that the observed relationship between ART use and retention is not due to confounding, though.
In this analysis, the regions analyzed were quite large, and economic, social, cultural, and political factors may vary widely even within regions (e.g., the most and least populous US states, California and Wyoming, respectively, are in the same geographic region- the West). Because within-region and between-region differences may play significant roles influencing differences in retention and other HIV outcomes, the monitoring of geographic trends in HIV clinical care, including all stages of the continuum, is an important activity to provide evidence for targeted outreach beyond a simple risk-group basis.
The additional analysis of ZCTA-level data, though providing a different lens through which to view demographic and HIV risk differences in retention in the US, add value in the additional layers of evidence they may provide to policy makers, particularly if individual-level data is unavailable.[65–67] Population-level differences in contextual factors such as poverty, crime, and housing instability may also be a desirable focus for policy when considering aggregate characteristics separately from individual characteristics related to care at a more granular level than the state or region. In this case, the differences observed are unlikely to stem from confounding by measured factors since the ZCTA-level analyses were adjusted using demographic and HIV risk characteristics, though they may be confounded by characteristics of the area of aggregation that were unavailable (such as public insurance income thresholds). Despite the limits in this context, these ZCTA-level analyses offer valuable insight into population-level processes such as persistent disparities in retention associated with regional age structure and racial composition that may be occurring in the care continuum at divisions smaller than the state level.
Scrutinizing outcomes at varying levels of geographic resolution is useful (and perhaps necessary) for detecting patterns that may otherwise be obscured. Noting retention patterns across ZCTA, state, and region levels, our work found fairly consistent trends, though the quality of inferences may not necessarily reflect the level at which public health actions are likely to be taken or at which effects may be most powerfully felt (Figs 3, 4 and 5). In the region-level map, the inter-regional disparities in retention are clearer, while increasing levels of magnification present a more complicated picture with the patterns less discernable. However, when describing disparate HIV quality of care outcomes, it may be particularly powerful to depict trends across areas that have been noted to have somewhat distinct cultures, political structures, and epidemic profiles, as denoted by the disaggregation of data across these very same regions in national HIV surveillance reports. The assessment and mapping of these outcomes at various levels, which is itself unusual, provides a compelling depiction of these HIV outcomes in a more easily accessible and readable format for both scientific and lay audiences.
Further analysis incorporating smaller geographic divisions with richer individual- and population-level data (e.g., Medicaid status at the individual-level) will be required to better understand how geographic factors, and the social-structural characteristics they may be proxies of, impact retention in clinical care and HIV outcomes.
There were limitations in this analysis. First, medical insurance status and economic security are important factors influencing access to and retention in clinical care and which we did not have access to. We did, however, use census-derived proxies for socioeconomic data such as the proportion of the ZCTA that was rural (indicating longer travel to receive care) and the proportion of the ZCTA living below the Federal poverty line (indicating economic and insurance resources available to patients). Second, the group under observation was successfully linked to care and engaged at cohort enrollment, and therefore may not represent populations of greatest concern in the early stages of the continuum of care.
Using data from a large North American collaborative HIV cohort, our analysis demonstrated a persistent upward trend in retention in care across the U.S., but one that was differential in its extent by region. These differences correspond with observations of regional differences in other HIV outcomes and highlight the utility of geographic data and analyses in monitoring progress in the continuum of care on both a national and a local basis. Though policy prescriptions and public health actions such as expanded testing and prevention services or improved linkage and treatment programs may help stem the tide of the epidemic, knowing that they may be more urgently needed in the South or the West, as opposed to the Northeast, is surely a critical piece of information.
Thank you to all collaborators, staff, and participants of the North American AIDS Cohort Collaboration on Research and Design, particularly to those cohorts contributing data to these analyses:
∎ Fenway Health HIV Cohort: Stephen Boswell, Chris Grasso, and Kenneth H. Mayer.
∎ HIV Outpatient Study: John T. Brooks and Kate Buchacz.
∎ HIV Research Network: Kelly A. Gebo and Richard D. Moore.
∎ Johns Hopkins HIV Clinical Cohort: Richard D. Moore.
∎ John T. Carey Special Immunology Unit Patient Care and Research Database, Case Western Reserve University: Benigno Rodriguez.
∎ Kaiser Permanente Northern California: Michael J. Silverberg.
∎ University of Alabama at Birmingham 1917 Clinic Cohort: Michael S. Saag, Michael J. Mugavero, and James Willig.
∎ University of North Carolina at Chapel Hill HIV Clinic Cohort: Joseph J. Eron and Sonia Napravnik.
∎ University of Washington HIV Cohort: Mari M. Kitahata and Heidi M. Crane.
∎ Veterans Aging Cohort Study: Amy C. Justice, Robert Dubrow, and David Fiellin.
∎ Vanderbilt-Meharry Center for AIDS Research Cohort: Timothy R. Sterling, David Haas, Sally Bebawy, and Megan Turner.
Conceived and designed the experiments: PFR SJG FCC. Performed the experiments: PFR. Analyzed the data: PFR. Contributed reagents/materials/analysis tools: SJG MAH SN HS RDM MMK TRS. Wrote the paper: PFR SJG MAH AGA SN HS BRY KNA RDM MMK TRS FCC. Refined Methods and Interpretation of data: AGA SN BRY KNA FCC.
- 1. Koch T. The map as intent: variations on the theme of John Snow. Cartographica: The International Journal for Geographic Information and Geovisualization. UT Press; 2004;39(4):1–14.
- 2. Richards TB, Croner CM, Rushton G, Brown CK, and Fowler L. Information technology: Geographic information systems and public health: Mapping the future. Public Health Reports. Association of Schools of Public Health; 1999;114(4):359.
- 3. Gao S, Mioc D, Anton F, Yi X, and Coleman DJ. Online GIS services for mapping and sharing disease information. Int J Health Geogr. England; 2008;7:8.
- 4. Houle B, Holt J, Gillespie C, Freedman DS, and Reyes M. Use of density-equalizing cartograms to visualize trends and disparities in state-specific prevalence of obesity: 1996–2006. Am J Public Health. United States; 2009;99(2):308–12.
- 5. Koch T, and Denike K. Medical mapping: The revolution in teaching—and using—maps for the analysis of medical issues. Journal of Geography. Taylor & Francis; 2004;103(2):76–85.
- 6. Klassen AC, Kulldorff M, and Curriero F. Geographical clustering of prostate cancer grade and stage at diagnosis, before and after adjustment for risk factors. Int J Health Geogr. 2005;4(1):1. pmid:15649329
- 7. Klassen AC, Curriero F, Kulldorff M, Alberg AJ, Platz EA, and Neloms ST. Missing stage and grade in Maryland prostate cancer surveillance data, 1992–1997. Am J Prev Med. Netherlands; 2006;30(2 Suppl):S77–87.
- 8. Wallace RG. AIDS in the HAART era: New York's heterogeneous geography. Soc Sci Med. England; 2003;56(6):1155–71.
- 9. Shacham E, Lian M, Önen NF, Donovan M, and Overton ET. Are neighborhood conditions associated with HIV management? HIV Med. England; 2013;14(10):624–32.
- 10. Eberhart MG, Yehia BR, Hillier A, Voytek CD, Blank MB, Frank I, et al. Behind the cascade: analyzing spatial patterns along the HIV care continuum. J Acquir Immune Defic Syndr. United States; 2013;64 Suppl 1:S42–51.
- 11. Centers for Disease Control and Prevention (CDC). Geographic differences in HIV infection among Hispanics or Latinos—46 states and Puerto Rico, 2010. MMWR Morb Mortal Wkly Rep. United States; 2012;61(40):805–10.
- 12. Trepka MJ, Fennie KP, Sheehan DM, Lutfi K, Maddox L, and Lieb S. Late HIV Diagnosis: Differences by Rural/Urban Residence, Florida, 2007–2011. AIDS Patient Care STDS. United States; 2014;28(4):188–97.
- 13. Tanser F, Bärnighausen T, Cooke GS, and Newell ML. Localized spatial clustering of HIV infections in a widely disseminated rural South African epidemic. Int J Epidemiol. England; 2009;38(4):1008–16.
- 14. Namosha E, Sartorius B, and Tanser F. Spatial clustering of all-cause and HIV-related mortality in a rural South African population (2000–2006). PLoS One. United States; 2013;8(7):e69279.
- 15. Hixson BA, Omer SB, del Rio C, and Frew PM. Spatial clustering of HIV prevalence in Atlanta, Georgia and population characteristics associated with case concentrations. J Urban Health. United States; 2011;88(1):129–41.
- 16. Geanuracos CG, Cunningham SD, Weiss G, Forte D, Reid LMH, and Ellen JM. Use of geographic information systems for planning HIV prevention interventions for high-risk youths. American Journal of Public Health. American Public Health Association; 2007;97(11):1974.
- 17. Hanna DB, Selik RM, Tang T, and Gange SJ. Disparities among US states in HIV-related mortality in persons with HIV infection, 2001–2007. AIDS. England; 2012;26(1):95–103.
- 18. Hanna DB, Buchacz K, Gebo KA, Hessol NA, Horberg MA, Jacobson LP, et al. Trends and disparities in antiretroviral therapy initiation and virologic suppression among newly treatment-eligible HIV-infected individuals in North America, 2001–2009. Clin Infect Dis. United States; 2013;56(8):1174–82.
- 19. Hanna DB, Buchacz K, Gebo KA, Hessol NA, Horberg MA, Jacobson LP, et al. Association between U.S. state AIDS Drug Assistance Program (ADAP) features and HIV antiretroviral therapy initiation, 2001–2009. PLoS One. United States; 2013;8(11):e78952.
- 20. Reif S, Whetten K, Wilson E, and Gong W. HIV/AIDS epidemic in the South reaches crisis proportions in last decade. Duke Center for Health Policy and Inequalities Research. 2011;.
- 21. Stone VE. HIV/AIDS in Women and Racial/Ethnic Minorities in the U.S. Curr Infect Dis Rep. United States; 2012;14(1):53–60.
- 22. Centers for Disease Control and Prevention (CDC). Vital signs: HIV prevention through care and treatment—United States. MMWR Morb Mortal Wkly Rep. United States; 2011;60(47):1618–23.
- 23. Edison L, Hughes D, Drenzek C, Kelly J, and Centers for Disease Control and Prevention (CDC). Prevalence and indicators of viral suppression among persons with diagnosed HIV infection retained in care—Georgia, 2010. MMWR Morb Mortal Wkly Rep. United States; 2014;63(3):55–8.
- 24. Ford MA, and Spicer CM. Monitoring HIV care in the United States: indicators and data systems. Monitoring HIV care in the United States: indicators and data systems. Washington, D.C.: National Academies Press; 2012.
- 25. Rebeiro PF, Horberg MA, Gange SJ, Gebo KA, Yehia BR, Brooks JT, et al. Strong agreement of nationally recommended retention measures from the Institute of Medicine and Department of Health and Human Services. PLoS One. United States; 2014;9(11):e111772.
- 26. Gardner EM, McLees MP, Steiner JF, Del Rio C, and Burman WJ. The spectrum of engagement in HIV care and its relevance to test-and-treat strategies for prevention of HIV infection. Clin Infect Dis. United States; 2011;52(6):793–800.
- 27. Mayer KH. Linkage, engagement, and retention in HIV care: essential for optimal individual- and community-level outcomes in the era of highly active antiretroviral therapy. Clin Infect Dis. United States; 2011. p. S205–7.
- 28. Cunningham CO, Buck J, Shaw FM, Spiegel LS, Heo M, and Agins BD. Factors associated with returning to HIV care after a gap in care in New York State. J Acquir Immune Defic Syndr. 2014;.
- 29. Howe CJ, Cole SR, Napravnik S, and Eron JJ. Enrollment, retention, and visit attendance in the University of North Carolina Center for AIDS Research HIV clinical cohort, 2001–2007. AIDS Res Hum Retroviruses. United States; 2010;26(8):875–81.
- 30. Hsu LC, Chen M, Kali J, Pipkin S, Scheer S, and Schwarcz S. Assessing receipt of medical care and disparity among persons with HIV/AIDS in San Francisco, 2006–2007. AIDS Care. England; 2011;23(3):383–92.
- 31. Mugavero MJ, Lin HY, Willig JH, Westfall AO, Ulett KB, Routman JS, et al. Missed visits and mortality among patients establishing initial outpatient HIV treatment. Clin Infect Dis. United States; 2009;48(2):248–56.
- 32. Mugavero MJ, Lin HY, Allison JJ, Giordano TP, Willig JH, Raper JL, et al. Racial disparities in HIV virologic failure: do missed visits matter? J Acquir Immune Defic Syndr. United States; 2009;50(1):100–8.
- 33. Park WB, Choe PG, Kim SH, Jo JH, Bang JH, Kim HB, et al. One-year adherence to clinic visits after highly active antiretroviral therapy: a predictor of clinical progress in HIV patients. J Intern Med. England; 2007;261(3):268–75.
- 34. Torian LV, and Wiewel EW. Continuity of HIV-related medical care, New York City, 2005–2009: Do patients who initiate care stay in care? AIDS Patient Care STDS. United States; 2011;25(2):79–88.
- 35. Ulett KB, Willig JH, Lin HY, Routman JS, Abroms S, Allison J, et al. The therapeutic implications of timely linkage and early retention in HIV care. AIDS Patient Care STDS. United States; 2009;23(1):41–9.
- 36. Whiteside YO, Cohen SM, Bradley H, Skarbinski J, Hall HI, Lansky A, et al. Progress along the continuum of HIV care among blacks with diagnosed HIV- United States, 2010. MMWR Morb Mortal Wkly Rep. United States; 2014;63(5):85–9.
- 37. Berg MB, Safren SA, Mimiaga MJ, Grasso C, Boswell S, and Mayer KH. Nonadherence to medical appointments is associated with increased plasma HIV RNA and decreased CD4 cell counts in a community-based HIV primary care clinic. AIDS Care. England; 2005;17(7):902–7.
- 38. Althoff KN, Rebeiro P, Brooks JT, Buchacz K, Gebo K, Martin J, et al. Disparities in the Quality of HIV Care When Using US Department of Health and Human Services Indicators. Clin Infect Dis. United States; 2014;58(8):1185–9.
- 39. Rebeiro P, Althoff KN, Buchacz K, Gill J, Horberg M, Krentz H, et al. Retention among North American HIV-infected persons in clinical care, 2000–2008. J Acquir Immune Defic Syndr. United States; 2013;62(3):356–62.
- 40. National HIV/AIDS strategy for the United States. White House Office of National AIDS Policy; 2010. Retrieved from: http://purl.access.gpo.gov/GPO/LPS124282
- 41. Accelerating Improvements in HIV Prevention and Care in the United States Through the HIV Care Continuum Initiative. Executive Order 13649. 78 FR 43057, July 18, 2013.
- 42. Improving Outcomes: Accelerating Progress Along the HIV Care Continuum. White House Office of National AIDS Policy. Retrieved from: http://www.whitehouse.gov/sites/default/files/onap_nhas_improving_outcomes_dec_2013.pdf
- 43. Yehia B, Frank I. Battling AIDS in America: an evaluation of the National HIV/AIDS Strategy. Am J Public Health. 2011 Sep;101(9):e4–8. pmid:21778507
- 44. Andersen RM. Revisiting the Behavioral Model and Access to Medical Care: Does it Matter? Journal of Health and Social Behavior. 1995;36(1):1. pmid:7738325
- 45. Althoff KN, Buchacz K, Hall HI, Zhang J, Hanna DB, Rebeiro P, et al. U.S. trends in antiretroviral therapy use, HIV RNA plasma viral loads, and CD4 T-lymphocyte cell counts among HIV-infected persons, 2000 to 2008. Ann Intern Med. United States; 2012;157(5):325–35.
- 46. Lau B, Gange SJ, and Moore RD. Interval and clinical cohort studies: epidemiological issues. AIDS Res Hum Retroviruses. United States; 2007;23(6):769–76.
- 47. Gange SJ, Kitahata MM, Saag MS, Bangsberg DR, Bosch RJ, Brooks JT, et al. Cohort profile: the North American AIDS Cohort Collaboration on Research and Design (NA-ACCORD). Int J Epidemiol. England; 2007;36(2):294–301.
- 48. Rebeiro PF, Althoff KN, Lau B, Gill J, Abraham AG, Horberg MA, et al. Laboratory Measures as Proxies for Primary Care Encounters: Implications for Quantifying Clinical Retention Among HIV-Infected Adults in North America. Am J Epidemiol. 2015 Dec 1;182(11):952–60. pmid:26578717
- 49. Centers for Disease Control and Prevention. HIV Surveillance Report, 2013; vol. 25. http://www.cdc.gov/hiv/library/reports/surveillance/. Published February 2015. Accessed October 29, 2015.
- 50. National Historical Geographic Information System: Version 2.0. Minnesota Population Center. Minneapolis, MN: University of Minnesota 2011. [cited 2014]. Retrieved from: https://www.nhgis.org/research/citation
- 51. Zou GY, and Donner A. Extension of the modified Poisson regression model to prospective studies with correlated binary data. Stat Methods Med Res. England; 2013;22(6):661–70.
- 52. Yan J, and Fine J. Estimating equations for association structures. Statistics in medicine. Wiley Online Library; 2004;23(6):859–874.
- 53. Pan W, and Connett JE. Selecting the working correlation structure in generalized estimating equations with application to the lung health study. Statistica Sinica. C/O Dr HC Ho, Inst Statistical Science, Academia Sinica, Taipei 115, Taiwan; 2002;12(2):475–490.
- 54. Harrell FE. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. New York: Springer; 2001.
- 55. Morris TP, White IR, and Royston P. Tuning multiple imputation by predictive mean matching and local residual draws. BMC Med Res Methodol. England; 2014;14:75.
- 56. Gardiner JC, Luo Z, and Roman LA. Fixed effects, random effects and GEE: what are the differences? Stat Med. England; 2009;28(2):221–39.
- 57. Hubbard AE, Ahern J, Fleischer NL, Laan MVD, Lippman SA, Jewell N, et al. To GEE or Not to GEE: Comparing Population Average and Mixed Models for Estimating the Associations Between Neighborhood Risk Factors and Health. Epidemiology. 2010;21(4):467. pmid:20220526
- 58. Baum CF. Stata tip 63: Modeling proportions. Stata Journal. Stata Press 4905 Lakeway Parkway, College Station, TX 77845 USA; 2008;8(2):299.
- 59. Papke LE, and Wooldridge J. Econometric methods for fractional response variables with an application to 401 (k) plan participation rates. Econometric methods for fractional response variables with an application to 401 (k) plan participation rates. National Bureau of Economic Research Cambridge, Mass., USA; 1993.
- 60. Westergaard RP, Ambrose BK, Mehta SH, and Kirk GD. Provider and clinic-level correlates of deferring antiretroviral therapy for people who inject drugs: a survey of North American HIV providers. J Int AIDS Soc. England; 2012;15(1):10.
- 61. Kurth AE, Mayer K, Beauchamp G, McKinstry L, Farrior J, Buchacz K, et al. Clinician Practices and Attitudes Regarding Early Antiretroviral Therapy in the US. JAIDS Journal of Acquired Immune Deficiency Syndromes. 2012;:1.
- 62. Gill MJ, and Krentz HB. Unappreciated epidemiology: the churn effect in a regional HIV care programme. Int J STD AIDS. England; 2009;20(8):540–4.
- 63. Giordano TP, Gifford AL, White AC, Suarez-Almazor ME, Rabeneck L, Hartman C, et al. Retention in care: a challenge to survival with HIV infection. Clin Infect Dis. United States; 2007;44(11):1493–9.
- 64. Marks G, Gardner LI, Craw J, and Crepaz N. Entry and retention in medical care among HIV-diagnosed persons: a meta-analysis. AIDS. England; 2010;24(17):2665–78.
- 65. Trepka MJ, Fennie KP, Sheehan DM, Lutfi K, Maddox L, Lieb S. Late HIV diagnosis: Differences by rural/urban residence, Florida, 2007–2011. AIDS Patient Care STDS. 2014 Apr;28(4):188–97. pmid:24660767
- 66. Musal M, Aktekin T. Bayesian spatial modeling of HIV mortality via zero-inflated Poisson models. Stat Med. 2013 Jan 30;32(2):267–81. pmid:22807006
- 67. Niyonsenga T, Trepka MJ, Lieb S, Maddox LM. Measuring socioeconomic inequality in the incidence of AIDS: rural-urban considerations. AIDS Behav. 2013 Feb;17(2):700–9. pmid:22711226
- 68. Jones SG, and Kulldorff M. Influence of spatial resolution on space-time disease cluster detection. PLoS One. United States; 2012;7(10):e48036.
- 69. Holtgrave DR, Hall HI, Wehrmeyer L, Maulsby C. Costs, consequences and feasibility of strategies for achieving the goals of the National HIV/AIDS strategy in the United States: a closing window for success? AIDS Behav. 2012 Aug;16(6):1365–72. pmid:22610372