This is an uncorrected proof.
Confronted with the challenge of understanding population-level processes, disease ecologists and epidemiologists often simplify quantitative data into distinct physiological states (e.g. susceptible, exposed, infected, recovered). However, data defining these states often fall along a spectrum rather than into clear categories. Hence, the host-pathogen relationship is more accurately defined using quantitative data, often integrating multiple diagnostic measures, just as clinicians do to assess their patients. We use quantitative data on a major neglected tropical disease (Leptospira interrogans) in California sea lions (Zalophus californianus) to improve individual-level and population-level understanding of this Leptospira reservoir system. We create a “host-pathogen space” by mapping multiple biomarkers of infection (e.g. serum antibodies, pathogen DNA) and disease state (e.g. serum chemistry values) from 13 longitudinally sampled, severely ill individuals to characterize changes in these values through time. Data from these individuals describe a clear, unidirectional trajectory of disease and recovery within this host-pathogen space. Remarkably, this trajectory also captures the broad patterns in larger cross-sectional datasets of 1456 wild sea lions in all states of health but sampled only once. Our framework enables us to determine an individual’s location in their time-course since initial infection, and to visualize the full range of clinical states and antibody responses induced by pathogen exposure. We identify predictive relationships between biomarkers and outcomes such as survival and pathogen shedding, and use these to impute values for missing data, thus increasing the size of the useable dataset. Mapping the host-pathogen space using quantitative biomarker data enables more nuanced understanding of an individual’s time course of infection, duration of immunity, and probability of being infectious. Such maps also make efficient use of limited data for rare or poorly understood diseases, by providing a means to rapidly assess the range and extent of potential clinical and immunological profiles. These approaches yield benefits for clinicians needing to triage patients, prevent transmission, and assess immunity, and for disease ecologists or epidemiologists working to develop appropriate risk management strategies to reduce transmission risk on a population scale (e.g. model parameterization using more accurate estimates of duration of immunity and infectiousness) and to assess health impacts on a population scale.
A pathogen can cause variable disease severity across different host individuals, and these presentations change over the time-course from infection to recovery. In addition, different pathogens may induce similar clinical presentations. These facts complicate efforts to identify infections caused by rare or neglected pathogens and to understand factors governing disease spread in humans and animals, particularly when data are limited. These biological complexities are omitted from classical approaches to modeling infectious disease, which typically rely on discrete and well-defined disease states. Here we show that by analyzing multiple biomarkers of health and infection simultaneously, treating these values as quantitative rather than binary indicators, and including a modest amount of longitudinal sampling of hosts, we can create a map of the host-pathogen interaction that shows the full spectrum of disease presentations and opens doors for new insights and predictions. By accounting for individual variation and capturing changes through time since infection, this mapping framework enables more robust interpretation of cross-sectional data; e.g., to detect predictive relationships between biomarkers and key outcomes such as survival, or to assess whether observed disease is associated with the pathogen of interest. This approach can help epidemiologists, ecologists and clinicians to better study and manage the many infectious diseases that exhibit complex relationships with their hosts.
Citation: Prager KC, Buhnerkempe MG, Greig DJ, Orr AJ, Jensen ED, Gomez F, et al. (2020) Linking longitudinal and cross-sectional biomarker data to understand host-pathogen dynamics: Leptospira in California sea lions (Zalophus californianus) as a case study. PLoS Negl Trop Dis 14(6): e0008407. https://doi.org/10.1371/journal.pntd.0008407
Editor: Jon Blevins, UAMS, UNITED STATES
Received: December 19, 2019; Accepted: May 21, 2020; Published: June 29, 2020
This is an open access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: This work was supported by the National Science Foundation Awards OCE-1335657 (https://www.nsf.gov/funding/pgm_list.jsp?org=OCE; JL-S, KCP) and DEB-1557022 (https://www.nsf.gov/funding/pgm_list.jsp?org=DEB; JL-S and KCP), the John H. Prescott Marine Mammal Rescue Assistance Grant Program (https://www.fisheries.noaa.gov/grant/john-h-prescott-marine-mammal-rescue-assistance-grant-program; JL-S, KCP), the Hellman Family Foundation (https://www.apo.ucla.edu/faculty-career-development/hellman-fellowship/hellman; JL-S), the US Department of Defense Strategic Environmental Research and Development Program Award RC-2635 (https://www.serdp-estcp.org/Funding-Opportunities/SERDP-Solicitations; JL-S, KCP), Cooperative Ecosystem Studies Unit Cooperative Agreement #W9132T1920006 (www.cesu.psu.edu; JL-S, KCP), the De Logi Chair in Biological Sciences (https://www.apo.ucla.edu/academic-listings/endowed-chairs; JL-S), and the Research and Policy for Infectious Disease Dynamics (RAPIDD) program of the Science and Technology Directory, Department of Homeland Security, and Fogarty International Center, National Institutes of Health (https://www.fic.nih.gov/About/Staff/Pages/epidemiology-population.aspx; JL-S, KCP, MGB). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
To gain insights into population-level trends, disease biomarker data are often reduced to binary form (e.g. presence/absence of a pathogen, antibodies or disease) for statistical analyses and parameterizing models of disease transmission. By contrast, to understand disease in an individual, the full quantitative range of available biomarker information is used to determine the precise clinical status of an individual, make treatment decisions, assess prognoses and limit transmission risk to others. While clinicians consider a clinically ill individual with a high or rising antibody titer as diagnostic of a current or recent infection , ecologists or epidemiologists typically classify individuals as exposed or not, and infected or not, based on a cut-off titer value , potentially discarding useful information contained in finer scale variations in titer magnitude. More detailed data on infection status and health can provide key information to both the clinician and ecologist that can help with accurate diagnosis (clinician) and effective system conceptualization, model construction and parameterization (ecologist and epidemiologist; see Fig 1 for details). However, such data can be difficult to interpret, particularly when limited data are available as for wildlife hosts and rare, emerging or neglected pathogens, and all data types may not be available for each individual assessed. Hence, cases captured in clinical and surveillance data often do not fit neatly into distinct categories, or may occasionally be misclassified as infections with a different pathogen. Severely ill, recently infected individuals are easily identified (e.g. by high antibody titer, pathognomonic clinical signs, detection of pathogen), but are often just the tip of the iceberg. In reality, a variety of presentations may exist at each point along the timeline from infection to recovery, with individuals exhibiting a range of disease severity and antibody titers (e.g. from severely ill to apparently healthy and with very high to undetectable titers), and with both infected and uninfected individuals detected at any given combination of disease severity and antibody titer (Figs 1 & 2, Table 1).
When susceptible individuals become infected (indicated by red shading–the intensity of shading indicates the probability that an assay for current infection–e.g. PCR–would be positive), they move through this space in a trajectory towards higher titer and more severe clinical disease states and then, depending on the type of pathogen and the host-pathogen interaction, they eventually return to a state of good health and their titers decline. The shape of this trajectory and their infection state will differ based on the host-pathogen system and the degree of heterogeneity in host responses. (A) shows the trajectory that would be expected based on the canonical SEIR model of infectious disease dynamics, with the position of individuals as they would pass through each of the four states–S, E, I, and R–indicated by the blue circles. Lower case letters a-h, representing individuals described in Table 1, show how individuals experiencing more complex host-pathogen interactions may fall outside of this canonical trajectory. (B) shows examples of alternative trajectories that individuals might trace through this host pathogen space, which can encompass these ambiguous states. Numbers correspond to those referenced in the text of Fig 1 and red shading is as described for (A).
Recently, efforts have been made to assess how biomarkers of disease and infection change relative to each other and over time, with the aim of identifying consistent patterns to improve our understanding of host-pathogen dynamics in human [3, 4], domestic animal , experimental , and wildlife systems [6, 7]. Longitudinal studies in which individuals are monitored through time provide key insights into how specific biomarkers, e.g. antibody titer, measures of disease severity, and pathogen load, change through the course of infection and recovery [7–10], with some studies showing how values may be associated with specific outcomes such as survival and transmission [4, 11]. In systems for which biomarkers show predictable temporal variation, quantitative data may provide information about an individual’s stage in the infection and recovery process [4, 6, 12, 13], enhancing our understanding of population-level dynamics by providing key data for model structure and parameterization, such as more accurate estimates of incidence, the shape and magnitude of key parameter distributions, and duration of protective immunity [6, 10, 12–19]. Assessment of quantitative values and multiple biomarkers can also elucidate individual within-host dynamics such as the outcome of an infection (infection chronicity, survival), how heterogeneity in antibody titer responses relates to clinical disease or symptoms, and probability of transmission to others [4, 11–13, 15, 20–22]. These findings can have direct implications on both the individual scale (e.g. triaging and treating patients, assessing prognosis, forward transmission risk, degree of protective immunity) and the population scale (e.g. controlling transmission and hence outbreaks, predicting population dynamics, estimating incidence and herd immunity, determining potential to act as a reservoir). The challenges of obtaining these key data, and the critical importance of having them, have become especially evident in light of the recent SARS-CoV-2 global pandemic for which limited data are available to inform individual treatment and quarantine recommendations, to parameterize mathematical models, and to guide population level public health policies aimed at reducing transmission to control the pandemic . Previous studies highlight the usefulness of including multiple data types, of understanding the nature of the relationship between multiple biomarkers of infection and disease, and of using quantitative data to better understand host-pathogen dynamics to make informed management decisions. However, although these studies explore facets of this new frontier in infectious disease dynamics, none combine all facets within a single study system, and few focus on disease in wildlife species.
We address this gap by linking longitudinal and cross-sectional data on multiple disease measures from an unconventional study system: Leptospira interrogans serovar Pomona (henceforth “Leptospira”) infection in California sea lions (Zalophus californianus). This system exhibits yearly, seasonal Leptospira outbreaks of varying magnitude, as reflected in both clinical cases of Leptospira infection seen at marine mammal rescue and rehabilitation centers  and in population-level serosurveys . Leptospira is a good model for examining complex manifestations of a host-pathogen relationship, as mammals infected by pathogenic species within the genus Leptospira can exhibit a wide range of clinical presentations, from fulminant clinical disease to silent infections, and while some hosts may clear the infection quickly, others continue to shed the pathogen for months to years. In addition, clinical signs of this neglected tropical disease can be similar to more commonly diagnosed pathogens, leading to misdiagnosis and underestimation of disease burden. The dominant clinical signs of leptospirosis (the disease caused by Leptospira infection) in California sea lions reflect the kidney damage inflicted by the bacteria, and clinically ill sea lions present in varying stages of renal failure. The host-pathogen relationship for pathogenic Leptospira spp., of which there are over 300 serovars , is conventionally attributed to specific Leptospira strain-host species pairs and described dichotomously, as an acute and potentially fatal infection in ‘accidental’ host species, or as a chronic and predominantly subclinical infection in ‘maintenance’ or reservoir host species [1, 27]. Yet, California sea lions show characteristics of both accidental and maintenance hosts despite the fact that only one serovar, L. interrogans serovar Pomona, has ever been isolated from this species, and is likely causing the vast majority, if not all, infections[28, 29]. During major outbreaks, roughly two-thirds of sea lions stranding with clinical Leptospira infections die–typical of accidental hosts. However, genetic evidence  and age-structured sero-epidemiology  suggest that Leptospira interrogans serovar Pomona is enzootic in the sea lion population, and furthermore subclinical chronic infections–typical of maintenance hosts–occur in sea lions and are the possible mechanism for population-level pathogen persistence from one outbreak to another [19, 29, 31].
Using longitudinal data on antibody titer, disease severity and pathogen shedding, we track the temporal progression of Leptospira infections in California sea lions that experienced either severe illness or subclinical infection. We use the relationship between these different biomarkers to create a ‘host-pathogen space’ in which we track the progression of known infected individuals through time and establish that they follow a clear, unidirectional trajectory. Using this mapping approach, we then plot cross-sectional data from a broader group of sea lions–either apparently healthy, wild-caught individuals, or those stranding due to a broad range of health issues (i.e. not pre-selected for or against leptospirosis), and use the patterns cast by the longitudinal data to interpret those in the cross-sectional data. In human terms, the longitudinal data are akin to disease-specific long-term monitoring of individual cases, whereas the cross-sectional data are akin to prospective, random population surveillance, and unfiltered sampling of hospital patients, and are therefore more representative of the overall population. We show that the longitudinal data broadly capture the patterns in the cross-sectional data, suggesting consistency in dynamics despite the greater set of individual presentations present in the cross-sectional data. Our identification of a consistent trajectory through host-pathogen space enables us to roughly situate cross-sectionally sampled individuals in their time-course of infection, showing how our approach could elucidate disease dynamics in many systems–from wildlife to humans–where most available data are cross-sectional. We also find that patterns within the host-pathogen space provide population-level insights into the range of disease experienced, duration of shedding, associations between antibody titer and infection status, and reservoir potential. This allows us to explore predictive relationships such as links between disease severity and survival, and between antibody titer and shedding duration. We also identify important differences between patterns in cross-sectional and longitudinal data, and generate and test hypotheses regarding the source of these differences, e.g., we identify renal disease from causes other than Leptospira. Our approach is particularly useful in the study of wildlife, emerging or neglected tropical diseases, where data are often limited, yet a broad understanding of disease dynamics is needed to guide appropriate public health recommendations and prospective surveillance efforts and experimental design.
Materials and methods
All California sea lion samples were collected under authority of Marine Mammal Protection Act Permits No. 932-1905-00/MA-009526 and No. 932-1489-10 issued by the National Marine Fisheries Service (NMFS), NMFS Permit Numbers 17115–03, 16087–03, and 13430. The sample collection protocol was approved by the Institutional Animal Care and Use Committees (IACUC) of The Marine Mammal Center (Sausalito, CA; protocol # 2008–3), the University of California Los Angeles (ARC # 2012-035-12), and the Marine Mammal Laboratory (Alaska Northwest 2013–1 and 2013–5). The Marine Mammal Center and the Marine Mammal Laboratory adhere to the national standards of the U.S. Public Health Service Policy on the Humane Care and Use of Laboratory Animals and the USDA Animal Welfare Act. UCLA and the U.S Navy Marine Mammal Program are accredited by AAALAC International and adhere to the national standards of the U.S. Public Health Service Policy on the Humane Care and Use of Laboratory Animals and the USDA Animal Welfare Act. Isoflurane gas was used to anesthetize all wild-caught, free-ranging sea lions for sampling, and from all stranded sea lions from which urine was collected.
The four groups of animals included in this study are summarized in Table 2.
Columns include the category of data “Group” and Sub-group”, the “Sample Size” of unique individuals, the “Selection Criteria” used for inclusion, the “Additional Details” regarding individuals included, the “Day 0”, i.e. the first day for which Leptospira infection related biomarkers were tracked in an individual, longitudinally monitored sea lion, and the “Length of Observation”, i.e. the period of time over which data were collected.
Wild-caught California sea lions.
Urine (n = 637) and serum (n = 732) samples were collected from anesthetized or physically restrained unique sea lions (n = 730; 2 animals were recaptured and resampled) caught between September 2008 and November 2014 from three regions–southern California (San Miguel and San Nicolas Islands), central California (Año Nuevo Island, Monterey and San Francisco’s Pier 39) and northern Oregon (Astoria, OR). All urine collection occurred under anesthesia. To minimize anesthetic risk, only apparently healthy animals were captured and sampled. Estimated ages ranged from 1 to 5 years. These animals represent a cross-sectional sampling of the apparently healthy, wild, free-ranging population and we refer to them as “WILD”.
Stranded California sea lions.
Urine (n = 166) and serum (n = 797) samples were collected from 724 unique California sea lions that stranded along the central and northern California coast and were admitted to a marine mammal rehabilitation center (The Marine Mammal Center, Sausalito, CA) between 2008 and 2014. Animals stranded due to illness or injury of all kinds, including, but not limited to leptospirosis, domoic acid toxicity, trauma, neoplasia, pneumonia and malnutrition. To match the age range for the wild-caught animals, only animals between the ages of 1 and 5 years were included in the study. These animals represent a cross-sectional sampling of the ill and injured sea lion population and we refer to them as “STRAND”. Only STRAND animals with both Microscopic Agglutination Testing (MAT) and chemistry results from within 14 days of each other were included in the study (>95% were from within 24-hours of each other). Urine PCR results were included only if these results were from urine collected within 24 hours of serum collection for chemistry analysis. This was to ensure that data on current infection (PCR) was from the same time point as data on clinical status (serum chemistry), which can change substantially quite rapidly. Serum antibody titers have a much slower rate of change, therefore we allowed serum MAT results to be within 14 days of PCR and serum chemistry sample collection dates.
CLINICAL: In 2010 and 2011, The Marine Mammal Center rescued and initiated treatment on 91 subadult, juvenile and yearling sea lions that stranded due to severe leptospirosis. Of these, 66 died, typically within days of stranding (median = 4 days, interquartile range = 2–7). We tracked the progression of host response (serum chemistry values, anti-Leptospira antibody titers) and active infection (leptospiral DNA shedding in urine) in 13 sea lions that survived to be released, and we refer to them as “CLINICAL” animals. Animals were diagnosed with leptospirosis using a combination of clinical observation, serum chemistry data and necropsy data . Animals were longitudinally sampled starting on Day 0 (their first day in rehabilitation; serum only) and then approximately every 14 days thereafter (serum and urine) until an individual’s release back into the wild 6–12 weeks later, as described in Prager et al. . These animals were not included in analyses of the larger STRAND dataset except when specifically noted.
SUBCLINICAL: Two animals, which we will refer to individually as SUB1 and SUB2, collectively as SUBCLINICAL, never showed clinical signs of disease the entire period during which they were monitored as determined by clinical observation, complete physical examinations, complete blood counts and serum chemistry data. SUB1 stranded as a yearling male (i.e. between 1 and 2 years) in southern California in June 2010 (as described in Prager et al. ) with a flipper injury that precluded release back into the wild, and initially had no detectable anti-Leptospira antibodies. SUB1 seroconverted (i.e. acquired anti-Leptospira antibodies) in rehabilitation, with no observed clinical signs, at some unknown time-point within a 15-month period and was shedding leptospiral DNA 62 days after the first detected anti-Leptospira antibodies . SUB1 was adopted by the U.S. Navy Marine Mammal Program (MMP) July 12, 2012, and samples were provided for monitoring every 1 to 9 months for a total of 44 months from the initial date that antibodies were detected. Because the date of infection was unknown, for our analyses we used the date of the first detected titer as Day 0. SUB2 stranded as a juvenile male (i.e. between 2–4 years), moderately underweight with a neck laceration, and was brought to The Marine Mammal Center October 22, 2011 for treatment. He showed no clinical signs of leptospirosis, but had an initial, moderately high anti-Leptospira antibody titer (log2 titer = 10). SUB2 was released back into the wild 3 weeks later but stranded again 3 months after the initial stranding event with flipper injuries and still no clinical signs of leptospirosis. He was never re-released and was adopted by the Navy July 11, 2012. Samples were provided for monitoring every 1–7 months for 44 months from Day 0, defined as the date of the first detected antibody titer, which was also the day of first stranding. It is possible that this animal experienced clinical disease prior to being monitored, however he never showed clinical signs consistent with leptospirosis while in rehabilitation or while at the U.S. Navy MMP. For both SUB1 and SUB2, the magnitude of the first detected anti-Leptospira antibody titers, and timing (autumn of 2011, during a major Leptospira outbreak in the wild sea lion population; Fig 3C & 3D and Fig 7A [24, 32]), suggest that exposure to Leptospira was recent–i.e. within weeks or months.
Renal index scores (A) and log2 anti-Leptospira antibody titer (C) by time in individual sea lions that stranded with clinical signs of leptospirosis and were followed for 6–12 weeks (CLINICAL dataset). Renal index scores (B) and log2 antibody titer (D) by time in two stranded sea lions–SUB1 (square, grey line) and SUB2 (triangle, orange line)–that never showed Leptospira-related clinical disease and were monitored for 3 years (SUBCLINICAL dataset). In panel D, regression lines, as determined by piecewise linear regression, are drawn through first and second phases of antibody titer decline for each SUBCLINICAL animal. For CLINICAL animals, day 0 is the day of admission to rehabilitation, for SUB1 and SUB2, day 0 is the day when anti-Leptospira antibodies were first detected. Grey horizontal bands in panels C and D delineate the full range of initial antibody titers in the CLINICAL animals, and in panels A and B they delineate the 95% interquantile range of renal index scores in apparently healthy, uninfected, seronegative wild-caught animals.
Samples collected from stranded animals (STRAND, CLINICAL and SUBCLINICAL) for this study were collected during routine clinical care at the rehabilitation centers and under their approved National Oceanic and Atmospheric Administration (NOAA), NMFS-Southwest Region Stranding Agreements under the authority of the Marine Mammal Protection Act. Samples collected from SUB1 and SUB2 at the U.S. Navy MMP were collected during their routine care and under U.S. Code, Title 10, USC 7524. The MMP houses and cares for a population of California sea lions in San Diego Bay (CA, USA). MMP is accredited by AAALAC International and adheres to the national standards of the U.S. Public Health Service Policy on the Humane Care and Use of Laboratory Animals and the Animal Welfare Act. During their clinical care, stranded animals received a variety of treatments which may have included, but were not limited to, subcutaneous fluids, antimicrobials, sedatives, and gastro-intestinal protectants.
Serum agglutination testing (MAT) was performed at the California Animal Health and Food Safety (CAHFS) laboratory, Davis, California, or at the Centers for Disease Control and Prevention (CDC), Atlanta, Georgia, using live cultured Leptospira spp. (reference strains) to measure the serum anti-Leptospira antibody titers. Samples run at CAHFS were run against a 6 serovar panel and samples run at the CDC were run against a 2 or 19 serovar panel (as described in Prager et al. ). We only report MAT titer results against L. interrogans serovar Pomona as historically this is the strain that elicits the highest MAT titer in the majority of California sea lions tested  and it is the only serovar ever isolated from this host species over five decades of study [28, 29]. Serum samples were tested at doubling dilutions starting from 1:100, and agglutination was read using dark field microscopy. Endpoint titers were reported as the highest dilution that agglutinated at least 50% of the cells for the strain tested . Titer results were log transformed for ease of interpretation using the following formula: log2(titer/100) + 1, thus a titer of 1:100 = 1, 1:200 = 2, etc. Titers reported as <1:100 were set equal to 0 on both the log and regular scale. Throughout the paper “antibody titer” refers to this log transformed titer value. All animals with a detectable titer (i.e. ≥1:100) were considered seropositive and assumed to have been infected with Leptospira at some point.
Serum chemistry analyses of wild-caught sea lions and stranded sea lions from The Marine Mammal Center were performed on an ACE Clinical Chemistry System (Alfa Wassermann, Inc., West Caldwell, New Jersey, USA), those of SUB1 were performed initially on either a VetTest 8008 Chemistry Analyzer (IDEXX Laboratories, Inc., Westbrook, Maine, USA) or a Cobas 800 modular analyzer (Roche Diagnostics, Indianapolis, Indiana, USA). Once SUB1 and SUB2 were at the MMP, serum chemistry analyses were performed on a Roche Cobas 8000 system (Roche Molecular Systems, Pleasanton, CA, USA) by the Naval Medical Center in San Diego, CA.
We assessed leptospiral DNA shedding in urine using real-time polymerase chain reaction (PCR) as described in Wu et al., . Because urine was collected under anesthesia, and anesthesia can pose a health risk to compromised animals, only apparently healthy wild-caught animals were caught and sampled, and of the STRAND animals, urine was collected only from those undergoing anesthesia for other reasons or during necropsy. Individuals shedding leptospiral DNA were considered infected and infectious as the primary mode of transmission of Leptospira is through either direct or indirect contact with leptospires shed in the urine of infected individuals .
Antibody titer kinetics.
For data from each CLINICAL individual, we used linear regression to characterize how the log2-transformed antibody titer declined with time. We calculated the rate of antibody titer decline as the slope of the regression line and the t ½ as the negative inverse of the slope. Using these data we determined the median titer decay rate and t1/2 for the CLINICAL animals.
Visual inspection of the SUBCLINICAL data suggested a biphasic pattern of titer decline (Fig 3D) during the time that they were monitored, echoing findings from earlier work [36, 37]. Thus we used piecewise linear regression to estimate the titer decline rate and t1/2 of the first and second phases separately for SUB1 and SUB2. For each animal, we estimated the specific day that determined the change point of the regression by fitting models over a range of possible change points from 10 to 500 days and using the day that yielded the model with the minimum mean-squared error.
We used the median antibody titer decline rate (r = 0.058 log2 antibody titer units/day) of the CLINICAL animals (Table 3) as well as their median initial antibody titer (ti = 11) to calculate an approximate estimate of the lower bound of shedding duration (D) in days for each observed titer level t in PCR-positive sea lions using the following equation:
This is a lower bound because it ignores further shedding after the date of observation, and it neglects any shedding that occurred at titer levels > ti.
Data are reported for each individual in the CLINICAL and SUBCLINICAL datasets as well as for the first and second phase of titer decline observed for the SUBCLINICAL animals. Rates for the CLINICAL animals are ordered from high to low with the median decline and half-life values in bold italics. The titer decline rate marked with an asterisk (*) was not significantly different from zero.
Similarly, using SUBCLINICAL animal biphasic decay rates, we calculated an approximate estimate of the duration of shedding (Ds) if an animal started at an initial titer equivalent to the median initial antibody titer of the CLINICAL animals (ti = 11) and continued shedding until the animal became seronegative. Using the following equation we used the SUBCLINICAL specific decay rates (Table 3; r1 and r2) to estimate the durations of the initial and secondary phases for each animal, and the SUBCLINICAL specific titer at which the phase switch occurred (SUB1 ts = 2; SUB2 ts = 5) to mark the switch from initial to second phase decay rates:
Blood urea nitrogen, creatinine, sodium, chloride and phosphorus are serum chemistry values known to change with leptospirosis-induced renal compromise . We used principal components analysis (PCA) to derive a single measure of renal function from these five serum chemistry values, which we termed the renal index. PCA was performed in R using the command “prcomp” in the program “stats”. BUN was log10 transformed and each individual serum chemistry measure was scaled to have unit variance prior to analysis. The dataset used included all longitudinal data (CLINICAL and SUBCLINICAL), as well as all WILD animals that were both seronegative for anti-Leptospira antibodies and negative for urinary leptospiral DNA shedding (i.e. the 0* group from Table 4). CLINICAL and SUBCLINICAL animals were included to capture the range of clinical compromise in infected animals from initial infection through recovery, and the subset of WILD animals was included to anchor the analysis with a group of apparently healthy, uninfected, unexposed animals. The first principal component (PC1) explained 54.8% of the variation in the data, and had factor loadings consistent with clinical reports of leptospirosis-induced disease (i.e. indicating elevated blood urea nitrogen, creatinine, sodium, chloride and phosphorus ). Therefore we used PC1 as the renal index to assess clinical severity of leptospirosis. Similar PCA results were found using just cross-sectional data (STRAND). To establish the range of values corresponding to healthy renal function, we computed the 95% interquantile range of renal index values (i.e. PC1) experienced by the apparently healthy WILD animals (-1.72 to 1.74). As values increased above this range, so did the degree of renal compromise.
Titer group “0” contains all seronegative animals, titer group 0* contains only non-shedding (i.e. urine PCR negative) seronegative animals. P-values are for two-sided bootstrap Kolmogorov-Smirnov (KS) test comparisons between animal groups of renal index distributions for a given titer. P-values for WILD 11+ v. WILD are for one-sided bootstrap KS test comparisons within the WILD dataset, with the null hypothesis that the renal index distribution for the 11+ titer group will be greater. P-values for STRAND 0* v. STRAND are for two-sided bootstrap KS test comparisons within the STRAND dataset comparing renal index distributions of seronegative, non-shedding animals with the other titer groups.
Predicting survival and shedding.
We used logistic regression to assess renal score as a predictor of survival in stranded animals at admission. We used the first sample available from all animals in the STRAND and CLINICAL groups with samples collected within 72 hours of admission (n = 103) and that were categorized as leptospirosis cases based on clinical signs and serum chemistry values (BUN > 100 mg/dl, creatinine > 2mg/dl). Because we sought to assess the usefulness of this prediction as a tool for triaging animals in a rehabilitation center, antibody titer data were not included as only serum chemistry results would be available at this time.
In a separate analysis, we used multivariate logistic regression to assess predictors of leptospiral DNA shedding. Candidate predictors included serum anti-Leptospira antibody titer, renal index scores, and the interaction between these two variables. The dataset included all study animals for which we had PCR results, but only the first PCR result per individual. We used the “anova” command in the R package “stats”  to perform backward stepwise selection and the likelihood ratio method to include only variables that contributed significantly at the 0.05 level to the final model. Our final model included only antibody titer, so we then used the relationship between shedding and titer to predict the shedding status of the untested animals. To do this, we calculated the expected number of shedders amongst the untested animals at each observed titer level using the total number of untested animals and the probability of shedding at that titer level. We then randomly selected this expected number of animals from amongst the untested animals at that titer level and assigned them a positive shedding status. We performed logistic regression in R using the “glm” command in the package “stats” .
Comparing Renal Index Distributions.
We used the Kolmogorov-Smirnov (KS) test to assess differences in distributions of renal index scores between groups of sea lions (CLINICAL, SUBCLINICAL, STRAND, and WILD) and within groups by anti-Leptospira antibody titer level. Because distributions were not continuous, we used the bootstrap Kolmogorov-Smirnov test “ks.boot” in the “Matching” package in R . To achieve sufficient sample sizes, titers were collapsed into five groups, based on the titer kinetics observed in longitudinally followed animals (CLINICAL and SUBCLINICAL). The highest grouping included titers ≥ 11, consistent with the majority of the initial titers in CLINICAL animals (11/13 had titers ≥ 11). All CLINICAL animals were in the healthy renal index range by the time they had a titer of 8 and were released by the time their titer declined to 6, so these levels were used to define the ranges of the next two groupings: titers 9–10 to capture animals recovering from clinical disease, and 6–8 to capture the recovered, subclinical phase as seen in CLINICAL animals. Titer group 1–5 captured the longer-term subclinical phase, as seen in SUBCLINICAL animals. Titer group 0 captured seronegative animals.
95% Confidence Intervals (CI).
95% CI in Fig 7 were calculated in R using binom.confint in the package “binom” using the Pearson-Klopper method . 95% CI for Table 3 were calculated using normal approximations based on linear regressions for antibody titer kinetics.
Establishing a Host-Pathogen trajectory with longitudinal data
We tracked the temporal progression of three important biomarkers of Leptospira infection–anti-Leptospira serum antibody titer, renal compromise, and urinary leptospiral DNA shedding–in 15 sea lions that were followed longitudinally from infection to clinical recovery. Thirteen of these were initially severely ill and were followed for 6–12 weeks (henceforth termed CLINICAL), and 2 never showed clinical signs and were followed for 3 years (termed SUBCLINICAL for subclinical, or SUB1 and SUB2 when referred to individually; Table 2). Combined, data from the CLINICAL and SUBCLINICAL animals enabled us to assess host-pathogen dynamics in animals exhibiting a range of initial clinical disease. The CLINICAL animals are typical of what would be reported by hospitals or rehabilitation centers for a given disease but may comprise only a small fraction of infections experienced in a population, especially in the case of pathogens that cause non-specific clinical signs and may be mis-diagnosed. The majority of acute infections may involve no evident disease, similar to the SUBCLINICAL animals, and would only be detected through prospective surveillance efforts and unfiltered sampling of hospital cases.
We tracked changes in clinical disease using our ‘renal index’. Within the first 72 hours of admission to rehabilitation the severely ill animals that survived (CLINICAL) had high initial renal index values that ranged from 4.15 to 13.67, but they recovered rapidly with all scores declining into the healthy range within 15 to 61 days (median = 27 days; Fig 3A). By contrast, in the three years that they were monitored, we never detected serum chemistry evidence of renal compromise in the subclinical animals (SUB1 and SUB2; Fig 3B).
Antibody titers in individual CLINICAL sea lions exhibited simple exponential decay (Fig 3C), while the SUBCLINICAL animals exhibited a more complex pattern. Visual inspection of the SUBCLINICAL data suggested a biphasic pattern with an initial rapid phase consistent with that of the CLINICAL animals, followed by much slower decay (Fig 3D). Antibody titer half-life (t1/2) estimates in CLINICAL sea lions ranged from 6.4 to 29.4 days with a median t1/2 of 17.1 days (Table 3). In the SUBCLINICAL sea lions we calculated first phase t1/2 values of 26.8 and 6.1 days for SUB1 and SUB2 respectively, and second phase values of 976 and 433 days (Table 3). The fact that first phase estimates for the two SUBCLINICAL animals fall within or close to the range seen for CLINICAL suggests consistency in early phase titer kinetics, regardless of the initial disease severity, and supports the assumption that our observations captured the end of the initial stage of infection for these SUBCLINICAL animals. Furthermore, our findings are qualitatively and quantitatively consistent with a pattern of initial rapid antibody decay followed by a slower decay, as seen in other systems where long-term antibody titer kinetics were tracked within individuals [36, 37].
To better understand the relationship between antibody titer and renal index, and to visualize how these biomarkers change relative to each other through time, we plotted the measures against each other to create a map of the host-pathogen space (Fig 4). With increasing time since infection, the CLINICAL animals followed a clear temporal trajectory, tracing a curved path starting in the high renal index and high titer space, dropping rapidly into the low renal index space with clinical recovery, and staying within the healthy range as antibody titers continued to drop (Fig 4A). In these CLINICAL animals, initial renal index values declined rapidly relative to antibody titers, so that only the earliest data points (<14 days since admission to rehabilitation) were found in the high titer, high renal index space. After 28 days, renal index scores leveled off within the healthy range and the temporal signal was dominated by antibody titer decline. By contrast, the SUBCLINICAL animals followed a straight path, always within the healthy range, as their antibody titers declined systematically throughout the 3 years that they were monitored (Fig 4A). All initial titers were high (log2 titer range CLINICAL = 10–13, SUBCLINICAL = 7–10) with variation among individuals observed. CLINICAL animals provided detailed information on initial changes in disease biomarkers, yet were released back into the wild within 6–12 weeks, providing no long-term data. In addition, as these animals stranded some unknown number of days after initial infection, the ‘upswing’ of antibody titers, shedding and clinical disease were not captured. Conversely, the SUBCLINICAL animals were followed for 3 years, providing important long-term biomarker data, but little on their initial dynamics (Table 2). Ultimately the CLINICAL and SUBCLINICAL paths overlapped, demonstrating convergence of the two trajectories and, potentially, similar long-term dynamics.
Maps of the host-pathogen space created by plotting jittered log2 anti-Leptospira antibody titers (x-axis) against renal index values (y-axis). Plots created using data from the longitudinally followed animals (CLINICAL and SUBCLINICAL), color-coded by time since admission to a rehabilitation center (A) and by urinary leptospire shedding status (B). Plots created using cross-sectional data from stranded animals (STRAND; C) and wild-caught, free-ranging animals (WILD; D) color-coded by urinary leptospire shedding status. In all panels, horizontal grey bands are equivalent to those in Fig 1C & 1D, and the vertical grey bands are equivalent to the horizontal bands described in Fig 1A & 1B.
Addition of a third disease biomarker–Leptospira DNA shed in urine–to the map of host-pathogen space revealed that many animals continued to shed despite a rapid return to healthy renal function and systematic antibody titer decline (Fig 4B). All CLINICAL sea lions tested positive at least once in the first 38 days, most (11/13) continued shedding despite concurrent antibody titer decline and clinical recovery, and most (10/13) were still shedding at the last sampling point 4–12 weeks after initial admission (Fig 4B; also see ). Subclinical shedding of at least 8 weeks was detected in SUB1 , indicating that initial severe clinical disease is not a necessary condition for shedding of this duration. Shedding was never detected in SUB2, but the first urine testing date was 38 weeks after first detection of serum antibodies.
Altogether, our findings suggest that antibody titers act as a rough clock indicating time since exposure to the pathogen, with data on disease severity and pathogen shedding improving the temporal resolution of the host-pathogen trajectory.
Using the Host-Pathogen trajectory to interpret cross-sectional data
Having established a temporal host-pathogen trajectory, we used our mapping approach to maximize the information gained from individuals observed only once. These cross-sectional data were from stranded (STRAND) and wild-caught, free-ranging (WILD) California sea lions (Table 2). When mapped, STRAND data fell along the trajectory mapped by the longitudinal data, but with greater variation, i.e., they cut a broader path through the host-pathogen space, and their map contained some outliers (Fig 4C). The STRAND data contained a wider range of renal index scores (-3.6–17.8) and a higher maximum antibody titer (log2 titer = 15) than did the longitudinal data (renal index = -1.0–13.7; maximum log2 antibody titer = 13; Fig 4A–4C), suggesting that STRAND data captured a greater overall range of sea lion-Leptospira host-pathogen dynamics than the smaller dataset of longitudinally followed animals. The larger size (50-fold larger than CLINICAL) and broader selection conditions (i.e. including animals so ill from leptospirosis they died quickly, as well as those compromised for other reasons) of the STRAND dataset could explain this difference. By contrast, and in keeping with our assessment of apparent health at capture, the WILD animals chiefly occupied the space defined by the SUBCLINICAL and the recovered CLINICAL animals (Fig 4D). Notably, the WILD and STRAND datasets both differed from the SUBCLINICAL and CLINICAL in that they contained substantial numbers of seronegative animals.
We analyzed the distribution of renal index scores in each group, using antibody titer levels to standardize for time since infection, in order to assess (1) whether each group had a unique renal index profile or whether the SUBCLINICAL, WILD and CLINICAL groups were merely opposite extremes within the range seen in the STRAND animals, with WILD and SUBCLINICAL at one extreme and CLINICAL at the other, and (2) whether all groups converged to the same point with time since infection (Fig 5; Table 4). Renal index distributions of WILD and SUBCLINICAL animals never differed significantly. Those of the WILD and CLINICAL animals differed significantly at each antibody titer level assessed, yet the difference between their mean renal index values decreased as titers decreased, i.e. they were converging with time since infection. While some STRAND animals exhibited markedly greater renal disease than WILD animals, at all titer levels, there is also substantial overlap between these groups, suggesting that the WILD animals are similar to the majority of STRAND animals not suffering from clinical leptospirosis. Altogether, for all datasets and regardless of the starting point in the trajectory (i.e. the renal index value at the highest titers), as antibody titers declined, so did mean renal index scores and the trajectories of each of the different datasets converged towards the healthy range.
Sample groups are as described in the methods and are wild-caught (WILD), subclinical (SUB), clinical (CLINICAL), stranded (STRAND) sea lions. Titer groups were chosen based on the titer dynamics observed in the longitudinally followed animals through time. Groups roughly match the different phases of the host-pathogen relationship ranging from initial infection (11+), clinical recovery (9–10) and two stages of historic infection (1–5 and 6–8). Group 0 contains seronegative animals. The grey line denotes the upper boundary of the healthy range for renal index values. The upper whisker extends from the hinge to the highest value that is within 1.5 * IQR of the hinge, where IQR is the interquartile range. The lower whisker extends from the hinge to the lowest value within 1.5 * IQR of the hinge.
As with the longitudinally sampled animals, leptospiral DNA was detected in both STRAND and WILD animals for a wide range of antibody titer and renal index values (Fig 4C & 4D). However, unlike the longitudinal groups, the cross-sectional data also included seronegative animals (i.e. no detectable anti-Leptospira antibodies; Fig 4C & 4D; plotted above log2 titer of 0). These animals presented with a range of renal index scores and, intriguingly, included animals shedding leptospiral DNA (Fig 4C & 4D; see section ‘Antibody Titer Kinetics and Shedding Duration’ for further discussion of these animals).
The broad congruence of the cross-sectional datasets with the longitudinally collected data corroborates the assumption that the CLINICAL and SUBCLINICAL animals jointly define the course of infection in this space and establishes that cross-sectional data can be interpreted within this temporal framework.
Tracking the distribution of disease severity
Defining the mean and range of pathogen-induced disease severity at different times since infection enhances our ability to interpret confusing host presentations (Figs 1 & 2, Table 1), understand disease dynamics in a system, and accurately assign disease to the correct etiology. Importantly, when using this approach, biases in data sources must be considered. In our study, when all data are combined, we see that initial disease severity (i.e. renal indices when animals have high antibody titers) ranges from healthy to severely ill (Fig 4). However, by design, initial renal index values in the CLINICAL animals captured only the upper range of disease severity, while the SUBCLINICAL animals occupied only the lower healthy range. WILD animals were sampled only if apparently healthy, and their renal index scores reflected this initial assessment, mostly occupying only the healthy range even during the presumed initial stage of infection (Fig 4 and Fig 5 titer level 11+). By contrast, STRAND data, which were collected without applying selection criteria to candidate animals, showed a wide range of initial disease severity and appear to knit together the various subset datasets to which specific selection criteria were applied (e.g. WILD, CLINICAL, SUBCLINICAL; Fig 4). Of note, although most of the seropositive WILD animals fall within the healthy range of renal index values, at the highest titer values a few exceed the healthy range (Fig 4D), and the mean renal index score of those individuals at this highest titer level is greater than those of the other levels (Fig 5; Table 4), suggesting that these animals can experience some degree of initial renal compromise from which they recover.
In many systems, disentangling disease caused by the pathogen of interest versus disease from another etiology can be difficult. In our study, while STRAND data capture the full spectrum of disease and follow the trajectory defined by the longitudinal data, this trajectory is shifted up the renal index axis and there are some obvious outliers (e.g. mid-low antibody titer, high renal index individuals; Fig 4C). STRAND renal index score distributions were significantly higher than those of almost all other datasets (i.e. CLINICAL, SUBCLINICAL, and WILD) at all antibody titer levels (with the single exception that renal index distributions for the highest-titer groups of STRAND and CLINICAL were indistinguishable (Fig 5; Table 4)). We hypothesize that this upward shift in STRAND renal index score is due to individuals experiencing renal compromise from causes other than leptospirosis and that overall STRAND host-pathogen dynamics are consistent with those described by the longitudinal data, i.e., animals are recovered clinically from leptospirosis by the time their log2 antibody titers have declined below 9 (Fig 4A–4C & Fig 5).
To test this idea, we analyzed the group of seronegative, non-shedding STRAND animals that were presumably never infected and never exposed. Any renal compromise observed in this group would be from a cause other than leptospirosis and the range of their renal index values provides a reference against which to compare currently or previously infected sea lions. We found that the renal index distribution of these seronegative, non-shedders in the STRAND dataset (denoted 0* in Table 4) was not significantly different from those of the mid and lower antibody titer STRAND groups (1–5, 6–8; (Fig 5; Table 4). This suggests that outliers found on the map–mid-low antibody titer with high renal index (Fig 4C)–which, according to the host-pathogen trajectory described in Fig 4A and 4B, should have fully recovered from Leptospira-induced renal compromise, are equivalent to the seronegative non-shedding STRAND animals experiencing disease from another etiology. Similar analyses of the WILD animals showed no significant difference between seronegative, non-shedding animals and animals with titers, further supporting our assumption of apparent health of this group.
In hospital and rehabilitation settings, determining probability of survival can be vital for patient triage and efficient allocation of resources. Using data on renal index scores that are readily available at admission, we found a significant negative relationship between these scores and survival of animals suspected of having leptospirosis (Fig 6; OR = 0.64, 95% CI = 0.53–0.78, p<0.001). This relationship is not only informative for guiding management in a clinical setting, but the absence of high renal index values in the WILD animals suggests that Leptospira-associated mortality in the apparently healthy animals selected for sampling is likely low.
The probability of survival as a function of renal index score plotted over histograms of the number of animals surviving (top histogram) or not surviving (bottom histogram) by renal index value. Analyses were run using data from samples collected within 72 hours of admission to a rehabilitation center from animals stranding and diagnosed with leptospirosis.
Antibody titer kinetics and shedding duration
Estimating an individual’s time since infection aids in assessing infection incidence, a quantity that is difficult to estimate for rare or poorly understood pathogens with limited data available [3, 6, 16] and is crucial for understanding pathogen dynamics and assessing model performance. In addition, combining infection incidence with data on shedding status can enable estimation of the duration of infectivity–a key model parameter which is notoriously difficult to determine in settings where repeated sampling of individuals is rare. To approach this problem, we explore the hypothesis that for our system there is a single dominant pattern of antibody titer decline, regardless of initial disease severity, such that titer acts as a rough measure of time since infection. We begin by noting that animals shedding leptospiral DNA exhibited antibody titers ranging from very high to seronegative (Fig 4B–4D; S1 Table). Under the working hypothesis that all animals experience similar antibody titer kinetics, low titer and seronegative shedders would be chronic shedders, versus individuals in the early phase of infection prior to mounting a robust immune response.
To test this idea we considered the epidemiological context of our data: during our study period, outbreaks occurred in 2008 and 2011 (Fig 7A). If antibody titer decline initially occurs rapidly as seen with the CLINICAL animals and then quite slowly as seen with the SUBCLINICAL animals (Fig 3C & 3D), we should see relatively few low titer animals during an outbreak year, and relatively more with each year until the next major outbreak. Similarly, observation of seronegative shedders should occur after outbreaks as titers dip below detection.
Proportion of stranded animals with leptospirosis (A), proportion of seropositive animals that have low titers (log2 titer 1–5) by year with 95% CI (B), and proportion of shedding animals that are seronegative by year with 95% CI (C). Total sample size for each proportion is indicated within the box. Only STRAND data included in (A) WILD and STRAND data for (B) and (C). The proportion of leptospirosis strands is highest in the two major outbreak years– 2008 and 2011 –and the proportion of low titer animals increases with each year after the outbreaks. Similarly, the proportion of seronegative shedders increases after the major outbreak in 2011, but then declines to zero by 2013. The single shedder in 2013 had a log2 antibody titer of 3, no animals were shedding in 2014; therefore a proportion could not be calculated. Few shedders were detected in 2008 and 2009 due to small sample sizes of animals PCR tested for shedding (2008 N = 6, 2009 N = 3, 2010 N = 71, 2011 N = 147, 2012 N = 116, 2013 N = 163, 2014 N = 291).
We found support for our hypothesis when we plotted data from the combined WILD and STRAND datasets. The proportion of low titer (log2 titer 1–5) animals increased following major outbreaks, particularly after 2011 when incidence remained very low (Fig 7A & 7B). Regarding seronegative shedding, as predicted the proportion of shedding animals that were seronegative was high in 2012, immediately following the 2011 outbreak; however, intriguingly, no seronegative shedders were detected in 2013 or 2014 (Fig 7C). No seronegative shedding was detected in 2008 and 2009 either, but this is likely due to very small sample sizes of animals tested in these years (N = 3–6) compared with 2010–2014 (N = 71–291; S1 Table).
Combined with our earlier result that antibody titers act as a rough measure of time since infection, this provides an opportunity to learn more about shedding duration. Precise quantitative estimates are impossible, particularly due to wide uncertainty on the slow decay rate of low titers, but a lower bound on shedding duration can be computed using the initial rapid decay rate. Assuming a constant titer decay rate of 0.058 log2 antibody titer units/day (the median decay rate of the CLINICAL animals) and an initial titer of 11 (the median initial titer of the CLINICAL animals), we conservatively estimate the approximate time taken to reach a given titer level (S2 Table), e.g. we calculate that it takes at least 189 days to reach seronegative status. From this, we can estimate the approximate duration of shedding for a PCR-positive individual with that antibody titer. However, applying similar logic to the decay curves suggested by the SUBCLINICAL animals, and still assuming an initial titer of 11, we obtain estimates of shedding duration for seronegative shedders that are much longer, e.g. ~ 6 years. Given the important caveats stated above and the low SUBCLINICAL sample size (N = 2), as well as further biological caveats discussed below, the true shedding duration of seronegative shedders likely falls somewhere between these two estimates.
Data on antibody titers (and in our case renal index, also derived from serum samples) are often more readily available than those on active pathogen shedding. If a clear relationship between one or both of these biomarkers and shedding can be established, then shedding may be predicted when shedding data are otherwise unavailable. Using a dataset including all animals (CLINICAL, SUBCLINICAL, WILD and STRAND) for which shedding data were available, we performed logistic regression to investigate how antibody titer and renal index were related to pathogen shedding (using only the first sample date per individual). We found that antibody titer contributed significantly to the final model (p<0.001), but that renal index (p = 0.96) and the interaction between renal index and antibody titer (p = 0.85) did not. The probability of shedding increased with increased antibody titer (Fig 8A; OR = 1.67, CI = 1.55–1.80). Using this relationship, we predicted shedding status in STRAND animals for which shedding data were missing, using only the first sample date per individual, and were able to produce a more complete map of the host-pathogen space (Fig 8B & 8C). Using all datasets, but including only the first sample collected for an animal, we estimated an overall shedding prevalence of 0.22 (PCR tested and untested, n = 1510) which is substantially higher than the prevalence of 0.15 calculated using the raw data (PCR tested only, n = 811), showing we may be greatly underestimating shedding prevalence when shedding data are rare relative to antibody titer data.
(A) The probability of shedding as a function of log2 anti-Leptospira antibody titer plotted over histograms of the number of animals shedding (top histogram) and not shedding (bottom histogram) by antibody titer (A). STRAND data plotted using the ‘host-pathogen map’ framework as in Fig 4C. Data divided into those individuals that were PCR tested and for which shedding status was known (B), and those that were not PCR tested and for which shedding status was predicted (C; positive = red, negative = black).
We have introduced a host-pathogen data visualization framework that characterizes the progression of L. interrogans infections and clinical responses in California sea lions, drawing on longitudinal data from individual animals, but validating the method using cross-sectional data. We propose that this framework is particularly useful in the study of wildlife, emerging or neglected tropical diseases, for it can provide key insights into the broad disease dynamics of a system, using data from individuals only sampled once.
The usefulness of our host-pathogen map for interpreting cross-sectional data in our system arises from the overall consistency in biomarker dynamics across individuals, and particularly within similar groups of individuals. In longitudinally sampled animals, we found that antibody titer acted as a rough clock marking time since infection. Although there was heterogeneity in initial antibody titers and decline rates, animals followed the same broad initial pattern of titer decline regardless of pathogen shedding status and initial disease severity. Our longitudinal data were censored–we lacked data from the earliest stages of infection in these stranded animals, especially for the SUBCLINICAL animals, and the CLINICAL animals were followed for at most 90 days–yet trajectories of antibody titer decline for both groups overlapped and converged, suggesting that ultimately they follow the same long-term dynamics. Analysis of cross-sectional data corroborated this finding, as they traced the same broad trajectory as the overlapping SUBCLINICAL and CLINICAL groups, knitting them together. In addition, consistent with our observation of an initial rapid antibody decline followed by a slow second phase of decline, cross-sectional data revealed that in the years following a major outbreak and before another one occurred, the relative proportion of low titer animals increased with time.
Our host-pathogen mapping approach has particular value in the context of Leptospira epidemiology, in resolving a challenge arising from the traditional dichotomous view of Leptospira-host relationships. This view describes host species as either maintenance hosts that experience little disease but can shed chronically for months to years, or accidental hosts that can become severely ill, and possibly die, but do not become chronically infected [1, 27]. Sea lions present a challenge to this view, as they show characteristics of both maintenance and accidental hosts. For example, sea lions showed a range of clinical disease in the initial stage of infection (i.e. at high titers), and although shedding was detected in the earliest phase regardless of clinical disease, there was substantial variation in shedding duration as determined by detection of both shedding and non-shedding sea lions at each antibody titer magnitude (including seronegative). Our mapping approach resolves this tension by showing that, in the case of Leptospira infection in sea lions, the accidental and maintenance host characteristics seen in individual sea lion presentations are extremes of a unifying trajectory of the host-pathogen interaction, and our map shows how these classical manifestations are linked both within an individual’s infection and at the population scale.
Characterizing the temporal trajectory of the infection and recovery process and establishing consistency in antibody kinetics is especially important for accurately interpreting the relationship between antibody titer and pathogen shedding. This enables rough estimation of shedding duration and potentially identification of chronic shedders–data that are key to accurate model parameterization and estimation of incidence, but notoriously difficult to collect for wildlife systems and neglected pathogens. Infectious disease theory predicts that shedding duration will influence transmission dynamics and modeling efforts have shown that chronically shedding individuals play a critical role in population-level pathogen persistence both in general  and specifically in California sea lions . Using our map of titer decay and clinical recovery, we identify low titer and seronegative shedders as likely chronic shedders, and using titer kinetics of longitudinally followed animals we obtain estimates of shedding duration from animals sampled only once. When used to parameterize models, these estimates must be considered in the context of the following caveats. Although we found that seronegative shedding occurred the year immediately after a major outbreak, it was not detected in the two years that followed, suggesting that titer decline may occur more rapidly in some individuals than predicted by SUBCLINICAL animal titer kinetics, and that shedding duration may be less than 2 years. However, the prevalence of longer-term chronic shedders might be quite low, resulting in low power to detect. Ultimately, although noisy, these field data align with our interpretation that animals that are shedding while seronegative (or low-titer seropositive) may be chronic shedders.
Quantitative analysis of biomarker data can also define relationships between biomarkers and specific disease outcomes. Results from these analyses can then be applied to fill gaps in incomplete datasets. This is particularly important as some desired data types are more difficult to obtain, or are unavailable at particular time points, e.g., survival data are only available when no longer clinically useful, or not available at all during the initial stages of zoonotic pathogen emergence, and urine can be more difficult to collect than serum. We predicted urinary shedding of Leptospira from antibody titer magnitude, and by applying this relationship across our full dataset we estimated a higher shedding prevalence than that in the smaller dataset for which shedding data were available. However, the opposite could have been true had the group composition been different in the smaller ‘training’ dataset. Therefore, in all cases of establishing these relationships between biomarkers, the impact of group composition and the epidemiological context of the data must be carefully considered. For example, in our case, seronegative shedding was more common the year following a major outbreak, had only these data been used when establishing the relationship between titer and shedding, shedding prevalence estimates would have been much higher. In future work, increasing the amount of data included–biomarker, demographic, environmental–in models defining these relationships, as in Borremans et al. , may further improve estimates by accounting for differences among individuals, and time periods.
By analyzing quantitative antibody titers jointly with other biomarker data, such as clinical or infection status, individuals that are indistinguishable by one measure but in fact are biologically distinct, may be better characterized and identified. For example, subclinical infection was seen across all titer levels, but severe disease was seen almost exclusively at high titers–as titers declined, only the rare outlier showed evidence of clinical disease. Using a binary approach to interpreting antibody titers, the outlier individuals with mid-low titer and severe renal disease may be categorized as ‘seropositive’ and miscategorized as acute Leptospira infections. However, through comparisons with a group of individuals thought never to have been infected, we show that these outliers were infected in the past (giving rise to the detected antibodies) but likely exhibited renal disease from another more recent etiology. This argument is supported by the lack of leptospiral DNA shedding in any of these outlier individuals. This general principle is relevant to the broader field of public health, and particularly for neglected tropical diseases, as a pervasive health issue in developing countries is the similarity in disease presentations among a diverse group of infectious and non-infectious etiologies (e.g. acute febrile illnesses; pneumonia; diarrheal disease [44, 45]) leading to possible misdiagnosis and subsequent incorrect model parameterization, incidence estimates, and clinical treatment of individuals. Quantitative analysis of multiple biomarkers, as exemplified by our host-pathogen map, facilitates identification of outliers and thus cryptic causes of disease. This information can aid appropriate treatment choice by clinicians, management recommendations by epidemiologists, and accurate estimation of health and economic burden of a particular pathogen by public health agencies [46, 47].
Using our map and analyses of multiple biomarkers we are able to make predictions regarding survival, shedding duration, and etiology of clinical disease. We propose that our approach, or a similar one, may be applied to other host-pathogen systems, but system-specific modifications may be required. In some systems, antibody titer dynamics and host clinical disease may contain more heterogeneity than seen in the Leptospira-sea lion system [6, 15, 16, 20, 21], necessitating adjustments in the interpretation (see Figs 1 & 2, Table 1 for more detail) or construction of the host-pathogen map such as using different biomarkers, or including more of them [4, 6]. For example, working in an experimental system, Torres et al.  used blood pathogen concentration, instead of antibody titer, and multiple measures of host health to build a map of ‘disease space’ within which individuals that became severely ill and died, and those that survived, traced different pathways as they moved from time since infection. They hypothesized that using this map they could plot cross-sectional data on malaria in humans and infer an individual’s infection time-line and predict their prognosis, but did not test this idea.
Heterogeneity in the maximum antibody titer, degree of clinical disease experienced, the shape of the titer decline curve, and the duration of detectable antibodies has been noted in a number of host-pathogen systems [8, 10, 13, 15, 20, 21], and in some cases, such heterogeneity is associated with specific characteristics of an individual’s infection. For example, in some host-pathogen systems, subclinical infections have been associated with lower maximum antibody titers [15, 21], and with shorter antibody titer persistence  than for clinical infections. Therefore, it was not obvious a priori whether antibody kinetics of subclinical and clinical infections would be the same in California sea lions. However, our findings, and those of others, indicate that despite some heterogeneity in antibody titer magnitude, titer kinetics for clinical and subclinical infections were roughly the same for Leptospira in sea lions and Q fever in humans .
Similarly other studies have examined whether chronic infections might be associated with different titer dynamics, e.g. higher maximum titers and longer persistence have been seen for chronic cases of Q fever [13, 20]. However, if anything, our data show the opposite trend. Instead of higher titers and greater antibody persistence, some of our hypothesized chronic carriers had no detectable antibodies, while our two subclinical animals–neither of which shed beyond the first several months of infection–had detectable antibody titers for years. Long-term persistence of antibodies in the SUBCLINICAL animals may be due to their captive status and its impact on overall condition and immune function. Alternatively, the long duration of detectable antibodies in the SUBCLINICAL animals and the lack of detectable titers in some of our shedders may reflect the full range of expected variation in titer decay rates and hence titer persistence.
The pattern of antibody titer decline in our sea lions, despite continued infection in some, may be specific to this particular host-pathogen interaction. For example, with some infections, including Q fever, the pathogen continues to circulate in the blood in chronically infected individuals, , stimulating the immune system to continue to produce antibodies and resulting in persistently high titers. Conversely, in chronic Leptospira infections, once leptospires have colonized the kidneys they appear to evade the host immune system [49, 50], which would explain the observed antibody titer decline in our system, despite chronic renal infection and shedding. Such differences between host-pathogen interactions can be visualized on our proposed host-pathogen map as a relatively higher density, or clustering, of cases in the medium to high titer, clinically impacted, infected region of the map (e.g. Q fever in humans), versus a more broad and even distribution of cases along the trajectory (e.g. leptospirosis in sea lions).
We believe our host-pathogen mapping approach yields many benefits, however the following caveats–some specific to our system, some more generalizable–must be considered. Individuals in any study population will experience differences in environmental exposures and conditions and we know that this, and age specific differences, can lead to variation in biomarker data. For example, adaptive immunity can be influenced by many factors including age, nutritional status and pathogen exposure history [51–53]. In addition, several idiosyncrasies in our study may have affected our findings. Estimates from the two SUBCLINICAL animals may not precisely reflect population level trends given the small sample size of the SUBCLINICAL group. Our observations were censored, as data from the CLINICAL animals were limited to the early phase of disease and recovery, there were only a few data points from this early phase of infection in the SUBCLINICAL animals, and the very earliest phase from infection to initial illness was unobserved for all animals. The initial infecting dose of Leptospira is unknown in all cases and may have varied substantially, potentially impacting immune response and disease severity. Both SUBCLINICAL and CLINICAL animals experienced potentially immunomodulatory conditions, specific to their time in captivity, that animals in the wild would not have. For example, the SUBCLINICAL animals remained in captivity where they were neutered and maintained in excellent body condition in a controlled, predator-free environment. Such conditions may have increased their reserves and their capacity to invest in a costly immune response , resulting in differences in long-term antibody titer kinetics relative to free-ranging animals, i.e. a slower decline and more persistent antibody titers. Similarly, CLINICAL animals received medical treatment and supportive care which may have affected survival, increased their reserves and boosted their immune potential. Together, these factors may help explain why estimates of shedding duration for seronegative shedders, based on SUBCLINICAL antibody titer kinetics (i.e. roughly 6 years to become seronegative), differed from patterns of seronegative shedding detected in the wild after a major outbreak (i.e. decline to seronegative within 2 years). However, despite the unique circumstances of our SUBCLINICAL and CLINICAL animals, the combined longitudinal datasets describe a multiphase titer decline consistent with that found in other studies [37, 55], and overall patterns seen in the longitudinal data were consistent with those in the cross-sectional data and likely reflective of the entire sea lion population.
Approaches that integrate biomarker kinetics to interpret cross-sectional data can be useful to clinicians, epidemiologists and ecologists alike, and bridge perspectives from these often separate worlds. Clinicians tend to focus on individual health, while ecologists and epidemiologists focus more on quantifying the natural process and understanding disease dynamics at the population scale. Using this integrated approach, clinicians can improve individual patient survival through more accurate patient triage and efficient allocation of resources, and can reduce transmission risk to others. Treatments that are expensive, of limited availability, or time intensive (e.g. dialysis) may be reserved for those individuals with the most severe disease and the lowest probability of survival in the absence of such therapy. Conversely, in a wildlife rehabilitation setting, limited resources might be directed towards those with the highest probability of survival. Stricter, but possibly more expensive, measures to prevent transmission can be efficiently directed at those individuals with the highest probability of shedding. Ecologists can better conceptualize model structure using estimates of shedding prevalence and duration and can better describe population level transmission dynamics. For example, Buhnerkempe et al.  found that the addition of a chronic shedder compartment to the traditional SIR (susceptible, infected, recovered/resistant) model was necessary to accurately describe California sea lion-Leptospira dynamics and to capture long-term patterns of pathogen persistence. Once model structure has been determined, survival probabilities and shedding duration based on quantitative data (e.g. health, antibody titers, PCR results) will inform parameter rate estimates (i.e. the duration spent in various model compartments) and show how individuals may contribute to onward transmission or herd immunity. Ultimately, these models are excellent tools for ecologists and epidemiologists to learn more about neglected, rare, emerging or poorly understood pathogens, especially when data are limited. They also present a means of integrating disease dynamics with population ecology. For most wildlife diseases, and many neglected tropical diseases, where disease related mortality is undetected or incorrectly attributed to a different disease, these models can be used to estimate the demographic impact of a disease on a population.
Historically, many of the principles of disease ecology were developed with childhood diseases such as measles in mind, and these acute infections have much crisper life histories for which the relatively simple SIR models can be used to capture the dynamics  (See Figs 1 & 2, Table 1). As the field addresses more complex host-pathogen relationships, these old assumptions break down and other models and approaches are needed. Models need to include greater complexity such as longer and variable infectious periods [19, 43], quantitative data and antibody titer kinetics [6, 15, 18], and multiple biomarkers of disease [3, 6]. Models based on quantitative data and that integrate antibody titer kinetics have been found to result in better estimates of model parameters (e.g. transmission rate, basic reproductive rate) and improved model performance and predictive capability (e.g. force of infection, incidence of infection), especially when only cross-sectional data were available [6, 10, 12–14, 16–18]. Similarly, models integrating quantitative serologic data may provide better estimates of incidence, especially relative to estimates based on reported rates of illness, as such reports miss subclinical infections [6, 12, 15–17]. We propose that our host-pathogen map provides a framework with which to visualize quantitative data from multiple biomarkers, determine the relationships between them, and identify the temporal trajectory of infection and recovery as reflected in changes in biomarker levels through time. This approach is of particular value for wildlife disease ecology and epidemiology of neglected, rare or emerging pathogens, since many host-pathogen relationships are poorly characterized, rely on cross-sectional data, and an in-depth study in a controlled experimental setting is generally not possible. Ultimately this approach can clarify the biology of more complex host-pathogen systems, enable the design of more appropriate dynamical models and statistical methods, and guide prospective experimental design, surveillance, and data collection to fill key knowledge gaps.
S1 Table. Total number of sea lions with a given log2 antibody titer by year for wild-caught (WILD), stranded (STRAND) and subclinically infected (SUB1 and SUB2) sea lions.
In parentheses are the number of animals shedding leptospires for each log2 antibody titer level over the total number of PCR tested animals.
S2 Table. Predicted shedding duration by titer level assuming a constant titer decay rate of 0.058 log2 antibody titer units/day (the median decay rate of the CLINICAL animals) and an initial titer of 11 (the median initial titer of the CLINICAL animals).
S1 Data. Raw data on used for analyses.
Columns include animal ID, DataType (i.e. CLINICAL, SUBCLINICAL, STRAND, WILD), AdmitYear (i.e. the year an animal was caught–WILD–or admitted for rehabilitation—CLINICAL, SUBCLINICAL, STRAND), SampleYearMAT (year serum was collected for serum MAT), LogMAT (log2 MAT result), SampleYearChem (year serum was collected for serum chemistry analysis), RenalIndex (renal index score calculated as described in the manuscript), SampleYearPCR (year urine was collected for PCR, PCR (result of PCR analysis), SurvivalData (information whether the animal survived or died during rehabilitation; wild-caught animals were released after capture, therefore survival data was unknown–NA), DaySinceAdmission (the number of days between admission to rehabilitation and date of sample collection for analysis (MAT, PCR, serum chemistry), DaysSinceFirstMAT (the number of days since sample collection for the first MAT analysis).
We would like to thank the volunteers, veterinarians, biologists and staff from The Marine Mammal Center (Sausalito, CA), The Marine Mammal Care Center Los Angeles, the Alaska Fisheries Science Center’s Marine Mammal Laboratory, Oregon and Washington Departments of Fish and Game, at the U.S. Navy Marine Mammal Program, the Año Nuevo State Park, and the University of California Santa Cruz’s Año Nuevo Reserve for their logistical support of this study and assistance with sample and data collection. In particular we would like to thank Carlos Rios, Lauren Palmer, Jeff Harris, Sharon Melin, Robert DeLong, Julia Burco, Patrick Robinson, Celeste Parry, Guy Oliver, and Pat Morris. We would also like to thank the Lloyd-Smith Laboratory at UCLA for useful discussions about the manuscript.
- 1. Faine S, Adler B, Bolin C, Perolat P. Leptospira and leptospirosis. 2 ed ed. Melbourne, Australia: MediSci; 1999.
- 2. Gilbert AT, Fooks AR, Hayman DT, Horton DL, Muller T, Plowright R, et al. Deciphering Serology to Understand the Ecology of Infectious Diseases in Wildlife. Ecohealth. 2013. Epub 2013/08/07. pmid:23918033.
- 3. Rydevik G, Innocent GT, Marion G, Davidson RS, White PC, Billinis C, et al. Using Combined Diagnostic Test Results to Hindcast Trends of Infection from Cross-Sectional Data. Plos Comput Biol. 2016;12(7):e1004901. Epub 2016/07/08. pmid:27384712; PubMed Central PMCID: PMC4934910.
- 4. Torres BY, Oliveira JH, Thomas Tate A, Rath P, Cumnock K, Schneider DS. Tracking Resilience to Infections by Mapping Disease Space. PLoS Biol. 2016;14(4):e1002436. pmid:27088359.
- 5. Strelioff CC, Vijaykrishna D, Riley S, Guan Y, Peiris JSM, Lloyd-Smith JO. Inferring patterns of influenza transmission in swine from multiple streams of surveillance data. Proceedings of the Royal Society B-Biological Sciences. 2013;280(1762). WOS:000319385100020. pmid:23658205
- 6. Borremans B, Hens N, Beutels P, Leirs H, Reijniers J. Estimating Time of Infection Using Prior Serological and Individual Information Can Greatly Improve Incidence Estimation of Human and Wildlife Infections. Plos Comput Biol. 2016;12(5):e1004882. Medline:27177244. pmid:27177244
- 7. Chantrey J, Dale T, Jones D, Begon M, Fenton A. The drivers of squirrelpox virus dynamics in its grey squirrel reservoir host. Epidemics-Neth. 2019:100352. Epub 2019/07/23. pmid:31327730.
- 8. Strid MA, Engberg J, Larsen LB, Begtrup K, Molbak K, Krogfelt KA. Antibody responses to Campylobacter infections determined by an enzyme-linked immunosorbent assay: 2-year follow-up study of 210 patients. Clin Diagn Lab Immun. 2001;8(2):314–9. Medline:11238214.
- 9. Teunis PF, van Eijkeren JC, de Graaf WF, Marinovic AB, Kretzschmar ME. Linking the seroresponse to infection to within-host heterogeneity in antibody production. Epidemics-Neth. 2016;16:33–9. pmid:27663789.
- 10. Wielders CCH, Teunis PFM, Hermans MHA, van der Hoek W, Schneeberger PM. Kinetics of antibody response to Coxiella bumetii infection (Q fever): Estimation of the seroresponse onset from antibody levels. Epidemics-Neth. 2015;13:37–43. WOS:000365890900005. pmid:26616040
- 11. Charleston B, Bankowski BM, Gubbins S, Chase-Topping ME, Schley D, Howey R, et al. Relationship Between Clinical Signs and Transmission of an Infectious Disease and the Implications for Control. Science. 2011;332(6030):726–9. pmid:21551063
- 12. Teunis PFM, van Eijkeren JCH, Ang CW, van Duynhoven YTHP, Simonsen JB, Strid MA, et al. Biomarker dynamics: estimating infection rates from serological data. Stat Med. 2012;31(20):2240–8. ISI:000307648900007. pmid:22419564
- 13. Teunis PFM, Schimmer B, Notermans DW, Leenders ACAP, Wever PC, Kretzschmar MEE, et al. Time-course of antibody responses against Coxiella burnetii following acute Q fever. Epidemiol Infect. 2013;141(1):62–73. ISI:000312037600008. pmid:22475210
- 14. Bollaerts K, Aerts M, Shkedy Z, Faes C, Van der Stede Y, Beutels P, et al. Estimating the population prevalence and force of infection directly from antibody titres. Statistical Modelling. 2012;12(5):441–62. WOS:000308652200003.
- 15. Buchy P, Vong S, Chu S, Garcia J-M, Hien TT, Hien VM, et al. Kinetics of Neutralizing Antibodies in Patients Naturally Infected by H5N1 Virus. Plos One. 2010;5(5):e10864. pmid:20532246
- 16. Pepin KM, Kay SL, Golas BD, Shriner SS, Gilbert AT, Miller RS, et al. Inferring infection hazard in wildlife populations by linking data across individual and population scales. Ecol Lett. 2017;20(3):275–92. WOS:000395169300001. pmid:28090753
- 17. Simonsen J, Mølbak K, Falkenhorst G, Krogfelt KA, Linneberg A, Teunis PFM. Estimation of incidences of infectious diseases based on antibody measurements. Stat Med. 2009;28(14):1882–95. pmid:19387977
- 18. Vinh DN, Boni MF. Statistical identifiability and sample size calculations for serial seroepidemiology. Epidemics-Neth. 2015;(0). http://dx.doi.org/10.1016/j.epidem.2015.02.005.
- 19. Buhnerkempe MG, Prager KC, Strelioff CC, Greig DJ, Laake JL, Melin SR, et al. Detecting signals of chronic shedding to explain pathogen persistence: Leptospira interrogans in California sea lions. J Anim Ecol. 2017;86(3):460–72. pmid:28207932.
- 20. Dupont HT, Thirion X, Raoult D. Q fever serology: cutoff determination for microimmunofluorescence. Clin Diagn Lab Immun. 1994;1(2):189–96. Medline:7496944.
- 21. de Graaf WF, Kretzschmar MEE, Teunis PFM, Diekmann O. A two-phase within-host model for immune response and its application to serological profiles of pertussis. Epidemics-Neth. 2014;9(0):1–7. http://dx.doi.org/10.1016/j.epidem.2014.08.002.
- 22. Teunis PFM, Teunis PFM, Ang CW, Strid MA, De Valk H, Sadkowska-Todys M, et al. Campylobacter seroconversion rates in selected countries in the European Union. Epidemiol Infect. 2013;141(10):2051–7. ISI:000323887200006. pmid:23228443
- 23. Enserink M, Kupferschmidt K. With COVID-19, modeling takes on life and death importance. Science. 2020;367(6485):1414. pmid:32217707
- 24. Gulland FMD, Koski M, Lowenstine LJ, Colagross A, Morgan L, Spraker T. Leptospirosis in California sea lions (Zalophus californianus) stranded along the central California coast, 1981–1994. Journal of Wildlife Diseases. 1996;32(4):572–80. ISI:A1996VN97900002. pmid:9359054
- 25. Lloyd-Smith JO, Greig DJ, Hietala S, Ghneim GS, Palmer L, St Leger J, et al. Cyclical changes in seroprevalence of leptospirosis in California sea lions: endemic and epidemic disease in one host species? BMC Infectious Diseases. 2007;7:125–36. ISI:000252421600001; PubMed Central PMCID: PMC2186333. pmid:17986335
- 26. Picardeau M. Virulence of the zoonotic agent of leptospirosis: still terra incognita? Nature Reviews Microbiology. 2017;15(5):297–307. pmid:28260786
- 27. Zuerner RL. Host Response to Leptospira Infection. In: Adler B, editor. Leptospira and Leptospirosis. Berlin, Heidelberg: Springer Berlin Heidelberg; 2015. p. 223–50.
- 28. Zuerner RL, Alt DP. Variable Nucleotide Tandem-Repeat analysis revealing a unique group of Leptospira interrogans serovar Pomona isolates associated with California sea lions. Journal of Clinical Microbiology. 2009;47(4):1202–5. ISI:000264797000047; PubMed Central PMCID: PMC2668322. pmid:19204099
- 29. Prager KC, Greig DJ, Alt DP, Galloway RL, Hornsby RL, Palmer LJ, et al. Asymptomatic and chronic carriage of Leptospira interrogans serovar Pomona in California sea lions (Zalophus californianus). Veterinary Microbiology. 2013;164(1–2):177–83. Epub 2013/02/20. pmid:23419822.
- 30. Zuerner RL, Cameron CE, Raverty S, Robinson J, Colegrove KM, Norman SA, et al. Geographical dissemination of Leptospira interrogans serovar Pomona during seasonal migration of California sea lions. Veterinary Microbiology. 2009;137(1–2):105–10. ISI:000266578400015. pmid:19186009
- 31. Prager KC, Alt DP, Buhnerkempe MG, Greig DJ, Galloway RL, Wu Q, et al. Antibiotic efficacy in eliminating leptospiruria in California sea lions (Zalophus californianus) stranding with leptospirosis. Aquatic Mammals. 2015;41(2):203–12. WOS:000358296900008. pmid:30792564
- 32. Greig DJ, Gulland FMD, Kreuder C. A decade of live California sea lion (Zalophus califorianus) strandings along the central California coast: causes and trends, 1991–2000. Aquatic Mammals. 2005;33(1):11–22.
- 33. Dikken H, Kmety E. Serological typing methods of leptospires. Bergan T, NOrris JR, editors. London, UK: Academic Press; 1978.
- 34. Wu Q, Prager KC, Goldstein T, D.P. A, Galloway RL, Zuerner RL, et al. Development of a real-time PCR for the detection of pathogenic Leptospira spp. in California sea lions. Diseases of Aquatic Organisms. 2014;110(3):165–72. WOS:000342923400001. pmid:25114040
- 35. Ellis WA. Animal Leptospirosis. In: Adler B, editor. Current Topics in Microbiology and Immunology: Leptospira and Leptospirosis. Current Topics in Microbiology and Immunology. Verlag Berlin Heidelberg: Springer; 2015. p. 99–137.
- 36. Amanna IJ, Hammarlund E, Lewis MW, Slifka MK. Impact of infection or vaccination on pre-existing serological memory. Human Immunology. 2012;73(11):1082–6. WOS:000310717500004. pmid:22902392
- 37. Hammarlund E, Thomas A, Amanna IJ, Holden LA, Slayden OD, Park B, et al. Plasma cell survival in the absence of B cell memory. Nature Communications. 2017;8(1):1781. pmid:29176567
- 38. R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2017.
- 39. Sekhon JS. Multivariate and Propensity Score Matching Software with Automated Balance Optimization: The Matching Package for R. Journal of Statistical Software. 2011;42(7):1–52.
- 40. Dorai-Raj S. binom: Binomial Confidence Intervals For Several Parameterizations. R package version 1.1–1 ed2014.
- 41. Stubben CJ, Milligan BG. Estimating and Analyzing Demographic Models Using the popbio Package in R. Journal of Statistical Software. 2007;22(11).
- 42. Wickham H. ggplot2: Elegant Graphics for Data Analysis. New York: Springer-Verlag; 2009.
- 43. Kramer-Schadt S, Fern·ndez N, Eisinger D, Grimm V, Thulke H-H. Individual variations in infectiousness explain long-term disease persistence in wildlife populations. Oikos. 2009;118(2):199–208.
- 44. Lozano R, Naghavi M, Foreman K, Lim S, Shibuya K, Aboyans V, et al. Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. The Lancet. 2012;380(9859):2095–128. https://doi.org/10.1016/S0140-6736(12)61728-0.
- 45. Murray CJL, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. The Lancet. 2012;380(9859):2197–223. https://doi.org/10.1016/S0140-6736>(12)61689-4
- 46. Bogich TL, Funk S, Malcolm TR, Chhun N, Epstein JH, Chmura AA, et al. Using network theory to identify the causes of disease outbreaks of unknown origin. J R Soc Interface. 2013;10(81).
- 47. Crump JA. Time for a comprehensive approach to the syndrome of fever in the tropics. Transactions of The Royal Society of Tropical Medicine and Hygiene. 2014;108(2):61–2. pmid:24463580
- 48. Kampschreur LM, Oosterheert JJ, Koop AMC, Wegdam-Blans MCA, Delsing CE, Bleeker-Rovers CP, et al. Microbiological Challenges in the Diagnosis of Chronic Q Fever. Clinical and Vaccine Immunology. 2012;19(5):787–90. WOS:000307108600022. pmid:22441385
- 49. Monahan AM, Callanan JJ, Nally JE. Review paper: Host-pathogen interactions in the kidney during chronic leptospirosis. Vet Pathol. 2009;46(5):792–9. Epub 2009/05/12. pmid:19429975.
- 50. Monahan AM, Callanan JJ, Nally JE. Proteomic analysis of Leptospira interrogans shed in urine of chronically infected hosts. Infect Immun. 2008;76(11):4952–8. Medline:18765721. pmid:18765721
- 51. Brodin P, Jojic V, Gao T, Bhattacharya S, Angel Cesar JL, Furman D, et al. Variation in the Human Immune System Is Largely Driven by Non-Heritable Influences. Cell. 2015;160(1):37–47. https://doi.org/10.1016/j.cell.2014.12.020.
- 52. Carr EJ, Dooley J, Garcia-Perez JE, Lagou V, Lee JC, Wouters C, et al. The cellular composition of the human immune system is shaped by age and cohabitation. Nature Immunology. 2016;17:461. https://www.nature.com/articles/ni.3371#supplementary-information. pmid:26878114
- 53. Martinez DR, Permar SR, Fouda GG. Contrasting Adult and Infant Immune Responses to HIV Infection and Vaccination. Clin Vaccine Immunol. 2016;23(2):84–94. PMC4744916. pmid:26656117
- 54. Lochmiller RL, Deerenberg C. Trade-offs in evolutionary immunology: just what is the cost of immunity? Oikos. 2000;88(1):87–98.
- 55. Andraud M, Lejeune O, Musoro JZ, Ogunjimi B, Beutels P, Hens N. Living on Three Time Scales: The Dynamics of Plasma Cell and Antibody Populations Illustrated for Hepatitis A Virus. Plos Comput Biol. 2012;8(3). Artn E1002418 ISI:000302244000026. pmid:22396639
- 56. Anderson RM, May RM. Population biology of infectious diseases.1. Nature. 1979;280(5721):361–7. ISI:A1979HE95900033. pmid:460412