Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A Prospective Study of the Incidence of Myocarditis/Pericarditis and New Onset Cardiac Symptoms following Smallpox and Influenza Vaccination

  • Renata J. M. Engler ,

    renata.engler@gmail.com

    Affiliations Military Vaccine Agency-Vaccine Healthcare Centers Network (currently Defense Health Agency, Immunization Healthcare Branch), Walter Reed National Military Medical Center, Bethesda, Maryland, United States of America, Department of Medicine and Pediatrics, Uniformed Services University of the Health Sciences, Bethesda, Maryland, United States of America

  • Michael R. Nelson,

    Affiliations Department of Medicine and Pediatrics, Uniformed Services University of the Health Sciences, Bethesda, Maryland, United States of America, Allergy-Immunology-Immunizations, Walter Reed National Military Medical Center, Bethesda, Maryland, United States of America

  • Limone C. Collins Jr.,

    Affiliation Military Vaccine Agency-Vaccine Healthcare Centers Network (currently Defense Health Agency, Immunization Healthcare Branch), Walter Reed National Military Medical Center, Bethesda, Maryland, United States of America

  • Christina Spooner,

    Affiliation Military Vaccine Agency-Vaccine Healthcare Centers Network (currently Defense Health Agency, Immunization Healthcare Branch), Walter Reed National Military Medical Center, Bethesda, Maryland, United States of America

  • Brian A. Hemann,

    Affiliations Cardiology Service, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, Maryland, United States of America, Department of Medicine, Uniformed Services University of the Health Sciences, Bethesda, Maryland, United States of America

  • Barnett T. Gibbs,

    Affiliations Cardiology Service, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, Maryland, United States of America, Department of Medicine, Uniformed Services University of the Health Sciences, Bethesda, Maryland, United States of America

  • J. Edwin Atwood,

    Affiliations Cardiology Service, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, Maryland, United States of America, Department of Medicine, Uniformed Services University of the Health Sciences, Bethesda, Maryland, United States of America

  • Robin S. Howard,

    Affiliation Department of Research Programs, Walter Reed National Military Medical Center, Bethesda, Maryland, United States of America

  • Audrey S. Chang,

    Affiliation Department of Research Programs, Walter Reed National Military Medical Center, Bethesda, Maryland, United States of America

  • Daniel L. Cruser,

    Affiliation Department of Pathology, Vassar Brothers Medical Center, Poughkeepsie, New York, United States of America

  • Daniel G. Gates,

    Affiliation Cardiology Service, Fort Belvoir Community Hospital, Fort Belvoir, Virginia, United States of America

  • Marina N. Vernalis,

    Affiliation Integrated Cardiac Health Project, Walter Reed National Military Medical Center, Bethesda, Maryland, United States of America

  • Marguerite S. Lengkeek,

    Affiliation Allergy and Asthma Care Centers, Chantilly, Virginia, United States of America

  • Bruce M. McClenathan,

    Affiliation Military Vaccine Agency-Vaccine Healthcare Centers Network (currently Defense Health Agency, Immunization Healthcare Branch), Womack Army Medical Center, Fort Bragg, North Carolina, United States of America

  • Allan S. Jaffe,

    Affiliation Division of Cardiovascular Diseases, Mayo Clinic, Rochester, Minnesota, United States of America

  • Leslie T. Cooper,

    Affiliation Division of Cardiovascular Diseases, Mayo Clinic, Rochester, Minnesota, United States of America

  • Steve Black,

    Affiliation Cincinnati Children's Hospital Center for Global Health, Cincinnati, Ohio, United States of America

  • Christopher Carlson,

    Affiliation Division of Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle, Washington, United States of America

  • Christopher Wilson,

    Current address: Bill and Melinda Gates Foundation, Seattle, Washington, United States of America

    Affiliation Department of Immunology, University of Washington, Seattle, Washington, United States of America

  •  [ ... ],
  • Robert L. Davis

    Affiliations Center for Biomedical Informatics, University of Tennessee Health Sciences Center, Memphis, Tennessee, United States of America, Oak Ridge National Laboratory, Oak Ridge, Tennessee, United States of America

  • [ view all ]
  • [ view less ]

Abstract

Background

Although myocarditis/pericarditis (MP) has been identified as an adverse event following smallpox vaccine (SPX), the prospective incidence of this reaction and new onset cardiac symptoms, including possible subclinical injury, has not been prospectively defined.

Purpose

The study’s primary objective was to determine the prospective incidence of new onset cardiac symptoms, clinical and possible subclinical MP in temporal association with immunization.

Methods

New onset cardiac symptoms, clinical MP and cardiac specific troponin T (cTnT) elevations following SPX (above individual baseline values) were measured in a multi-center prospective, active surveillance cohort study of healthy subjects receiving either smallpox vaccine or trivalent influenza vaccine (TIV).

Results

New onset chest pain, dyspnea, and/or palpitations occurred in 10.6% of SPX-vaccinees and 2.6% of TIV-vaccinees within 30 days of immunization (relative risk (RR) 4.0, 95% CI: 1.7-9.3). Among the 1081 SPX-vaccinees with complete follow-up, 4 Caucasian males were diagnosed with probable myocarditis and 1 female with suspected pericarditis. This indicates a post-SPX incidence rate more than 200-times higher than the pre-SPX background population surveillance rate of myocarditis/pericarditis (RR 214, 95% CI 65-558). Additionally, 31 SPX-vaccinees without specific cardiac symptoms were found to have over 2-fold increases in cTnT (>99th percentile) from baseline (pre-SPX) during the window of risk for clinical myocarditis/pericarditis and meeting a proposed case definition for possible subclinical myocarditis. This rate is 60-times higher than the incidence rate of overt clinical cases. No clinical or possible subclinical myocarditis cases were identified in the TIV-vaccinated group.

Conclusions

Passive surveillance significantly underestimates the true incidence of myocarditis/pericarditis after smallpox immunization. Evidence of subclinical transient cardiac muscle injury post-vaccinia immunization is a finding that requires further study to include long-term outcomes surveillance. Active safety surveillance is needed to identify adverse events that are not well understood or previously recognized.

Introduction

More than 2 million U.S. service members have been immunized since December 2002 to prevent smallpox infection [1]. Over 290 million doses of smallpox vaccine (SPX) are available for immunization of the U.S. population in the event smallpox is used as an agent of bioterrorism [2]. Myocarditis and/or pericarditis (MP) have been causally linked to smallpox vaccination in retrospective epidemiological studies and clinical trials that led to FDA approval of the current cell culture derived vaccine [35]. Prelicensure study data for the newer cell culture derived vaccine suggested higher incidence rates of myocarditis/pericarditis (MP) following both the calf-lymph and cell culture derived vaccine product (ACAM2000) [5]. Based on a healthy cohort of service members with no prior vaccine exposure (primary vaccinees) in 2002–2003, the incidence rate of clinically diagnosed MP was estimated at 16.1 cases per 100,000 smallpox vaccine recipients, nearly 7.5-fold higher than the expected background rate of 2.16 per 100,000 among comparable unvaccinated service members [3]. An expanded Department of Defense (DoD) population-based estimate for clinically diagnosed MP in over 730,000 SPX vaccinees was approximately 12 per 100,000 [4]. Public health passive surveillance for adverse events following immunization may underestimate the true incidence of causally associated events [6, 7].

The primary objectives of this study were to determine the incidence of new onset cardiac symptoms, clinical myocarditis/pericarditis and cardiac specific troponin T (cTnT) increases following SPX immunization. Secondary objectives included comparison of the results to a pilot study of 200 subjects receiving annual trivalent influenza vaccine (TIV) and comparison of published cohort data related to background MP incidence rates in healthy service members not exposed to SPX [3].

Methods

A multi-center, prospective, observational cohort study included healthy subjects receiving either the live attenuated smallpox (vaccinia) or an annual inactivated trivalent influenza (TIV) vaccine.

Cohorts

Study participants were recruited by research nurses from healthy service members and Military Health System beneficiaries with occupational and/or clinical requirements for the vaccine at participating immunization clinics at study sites. Recruitment methods included local printed media advertisements as well as brief announcements about the study predominantly in immunization clinic waiting areas. All subjects were enrolled from August 2004 through June 2010 at multiple sites with written informed consent authorized by an institution-specific protocol. Approvals for this study were obtained from Institutional Review Boards at Walter Reed Army Medical Center, Washington, DC, Womack Army Medical Center, Fort Bragg, NC, and Brooke Army Medical Center, San Antonio, TX. We estimate about 5 to 20 thousand people were exposed to outreach and advertisement efforts. Telephonic and/or electronic mail follow-up to determine possible occurrence of new cardiac events following completion of study visits and blood draws (within 30 days following immunization) was conducted (starting between day 45–60) and was finalized by January 2011.

Inclusion and Exclusion Criteria

Healthy active subjects presenting for either smallpox or annual influenza immunization as part of their military readiness and/or preventive health care requirements were considered for enrollment. Exclusion criteria included prior history of cardiac disease, diabetes, uncontrolled hypertension or specific medical exclusion for immunization. Military Health System standard of care guidelines for smallpox vaccine medical exemptions included a history of atopic dermatitis, cardiac disease or three or more cardiac risk factors, immune deficiency or immunosuppressive therapies, or any chronic illness potentially increasing the risk of vaccinia complications as assessed by clinical screening [8]. Both cohorts were without systemic symptoms of illness at the time of immunization and had no history of chest pains in the previous 72 hours. Additional exclusion criteria included pregnancy and age less than 18 years of age.

Cohort Clinical Visits

Both study cohorts were evaluated during a pre-immunization visit and up to 2 post-vaccine visits (day 5–8 and/or day 9–28). Baseline data including age, race/ethnicity, sex, cardiac risk factors, atopic/medical history, and fitness assessments as measured by physical training abilities, were collected on the day of the SPX or TIV immunization. Clinical data including cardiac symptoms with visual analogue scale rating (0–10) of severity and 12-lead electrocardiograms (ECG) were collected at baseline and at up to two post-vaccine visits between days 5 and 30. Blood samples were collected by standardized venipuncture and rapidly processed (<1 hour) for specific testing. Sera were rapidly aliquoted and frozen to minus 80 degrees Celsius.

Electrocardiograms

Standard 12-lead ECGs were performed using certified local clinic-based equipment. ECG tracings from all available visits were reviewed in a single session to rectify inaccurate machine reads when appropriate, and to validate changes from baseline. Potentially pathologic ECG changes were prospectively defined according to published criteria and included the following: (1) ST-segment elevation ≥1 mm (0.1 mV) elevation in two or more contiguous leads and not consistent with early repolarization (based on blinded consensus expert cardiology review), (2) T-wave changes (inversion, becoming negative) and/or (3) new arrhythmias (paroxysmal or sustained atrial or ventricular arrhythmias), (4) AV nodal conduction delays or intraventricular conduction defects, or (5) continuous ECG monitoring that detects frequent atrial or ventricular ectopy [9]. ECGs showing changes consistent with pericarditis and/or myocarditis underwent a second blinded review by a different cardiologist, along with a 4:1 sample of normal ECGs from the study subjects initially read as normal and of comparable age and sex. There were no disagreements noted between the 1st and 2nd readings performed in accordance with recommendations for standardization and interpretation of electrocardiograms published by the American Heart Association [9].

Cardiac Biomarkers—cTnT

Samples for cTnT were measured using the Cobas Troponin T Short Turn-Around Time Cardiac T electrochemiluminescence immunoassay in a College of American Pathologists accredited laboratory. Monoclonal antibodies used in this system have minimal cross reactivity with non-cardiac troponin-T (h-skeletal muscle troponin T 0.001%, h-skeletal muscle tropomyosin 0.001%). The 99th percentile cut-off for a normal level of cTnT (lower limit of detection) for this assay was <0.01 nanograms/milliliter (ng/ml) [1013]. This cut-off level has been previously validated in normal populations with a coefficient of variation of <10%. The prevalence of cTnT levels ≥0.01 ng/ml published by Wallace et al. [12] for a civilian general population cohort (n = 3557) was 0.7%. Even subjects with minimal increases (0.01 to 0.02 ng/ml, compared to ≥0.03 ng/ml) had increased prevalence of cardiac comorbidities. It is noteworthy that a subsequent study with a high sensitivity cTnT assay (De Lemos [14, 15]) showed no difference in cTnT elevations between smokers and non-smokers, a potential confounder in younger service members. Serial samples from each subject were tested at the same time in the same assay run (thawed for the first time) to reduce inter-assay variability and to optimize for each subject the post vaccine comparison with pre-immunization cTnT levels as their personalized normal baseline control value.

MP Diagnosis

Clinical myocarditis and pericarditis cases arising from the two prospective cohorts were independently adjudicated based on published epidemiological case definitions [16] that require the development of new onset cardiac symptoms in temporal association with vaccine exposure. Tables 1 and 2 outline the criteria for case definitions used in this study.

thumbnail
Table 1. Myocarditis case definition for surveillance of adverse events after smallpox vaccination in the United States, 200313.

https://doi.org/10.1371/journal.pone.0118283.t001

thumbnail
Table 2. Pericarditis case definition for surveillance of adverse events after smallpox vaccination in the United States, 200313.

https://doi.org/10.1371/journal.pone.0118283.t002

Possible Subclinical Myocarditis/Pericarditis Case Definitions

Possible subclinical pericarditis was defined as new-onset characteristic ECG changes at any post-vaccine visit, in the absence of new-onset cardiac symptoms. Cardiac troponin T is a laboratory measure specific for myocardial injury with elevations above 0.01 ng/ml (10 ng/L) [1013]. A single elevated cTnT measurement in a study of a general population has been associated with increased risk of mortality and cardiac morbidity on long-term follow-up [12]. New elevations were used as a surrogate biomarker of possible subclinical myocarditis in the prospective study populations. We defined possible subclinical myocarditis as the development of any one of the following: a) elevated post-vaccine levels of cTnT ≥ 0.02 ng/ml with pre-vaccine cTnT levels <0.01 ng/ml; or b) a post-vaccine cTnT level of 0.02 ng/ml greater than the pre-vaccine level based on the imprecision profiles of the assay. This conservative change value, double the lower limit of assay detection (0.01 ng/ml), was adopted to account for the imprecision profile of the cTnT assay equipment used to make the measurements.

Comparison to Cohorts from Peer-Reviewed Studies

A 2002 background incidence of MP among 1,390,352 service members (no exposure to vaccinia) was used to calculate the relative risk of post-SPX clinical MP identified in this prospective study [3]. Table 3 provides further details about this reference control population (non-vaccinated) and data concerning the incidence rate of post-primary SPX MP in 347,516 SPX vaccinees between December 2002-September 2003. Cases in this SPX published cohort were identified over any 30-day post-vaccination period using ICD-9-CM (International Classification of Diseases, Ninth Revision) codes specific for the diagnoses of interest (420.90, 420.99, unspecified and other acute pericarditis; 422.90, 422.91, acute unspecified and idiopathic myocarditis; and 429.0, unspecified acute myocarditis).

thumbnail
Table 3. Characteristics of two (2) published cohorts of healthy adults providing data regarding the incidence rates of myocarditis/pericarditis (MP) per 100,000 (prior to or following SPX)3.

https://doi.org/10.1371/journal.pone.0118283.t003

Statistical Analysis

For univariate analysis comparing cohorts, continuous and ordinal data were analyzed using the two-sample t-test. Categorical outcomes were examined using Fisher's exact test. Relative risks are presented with 95% confidence intervals (95% CI). The association of type of vaccine with new onset cardiac symptoms in the SPX and TIV cohorts, controlling for differences in baseline characteristics between groups, was examined using a log-binomial regression model. For analyses of clinical and subclinical MP, incidence rates and the 95% CI per 100,000 vaccinees (SPX and TIV cohorts) as well as relative risks (with 95% confidence intervals) were computed based on the Poisson distribution; cohorts were compared using the homogeneity test for Poisson rates. Data were analyzed from 2011 to 2013 using SPSS for Windows (v. 19 SPSS/IBM, Chicago IL) and StatXact (v.8 Cytel Inc., Cambridge MA).

Results

Of 1245 volunteers enrolled in the SPX cohort and 200 in the pilot TIV cohort, 1081 SPX and 189 TIV vaccinees completed at least 2 visits (Fig. 1) and were used for analysis of incidence of new onset cardiac symptoms and clinical MP as well as dynamic changes in cTnT levels. In the SPX cohort, 164 were lost to follow-up after visit 1 due to scheduling conflicts and/or deployment. No subjects from the SPX and TIV cohorts presented acutely with clinical signs of MP prior to day 5 post-vaccine. Data was recorded on subject outcomes for at least 30 days following immunization by telephone or electronic mail following the last visit to assure that no cardiac symptoms or events occurred within the 30 day period after immunization.

thumbnail
Fig 1. Subject enrollment, exclusions and outcomes for two prospective cohorts, post-smallpox and annual trivalent influenza vaccine.

https://doi.org/10.1371/journal.pone.0118283.g001

Baseline assessments for the SPX and TIV cohorts are listed in Table 4. Subjects in the SPX cohort were younger, predominantly male and current or recent smokers. There was no significant difference in pre-immunization health self-assessment between groups. During the study period, there was no active participation in triathlons or prolonged endurance training exceeding the usual ongoing fitness training. Male subjects in the TIV cohort were heavier and older. The TIV cohort also self-assessed more frequently for physical limitations that presumably might reduce physical activity. However, all subjects in the TIV cohort were healthy, active adults, capable of meeting the physical fitness levels required for active duty service including completion of semi-annual physical fitness tests (adjusted for age and some physical limitations such as doing a fast walk rather than a run). The proportion of individuals with pre-vaccine baseline cTnT levels of ≥0.02 ng/ml (>2-fold higher than the >99th percentile cut-off for the clinical assay) was not significantly different between TIV (0%) and SPX (1.0%) groups and comparable to the background rate in a healthy population [12, 14].

thumbnail
Table 4. Baseline demographic and clinical characteristics of smallpox (SPX) and trivalent inactivated influenza vaccine (TIV) cohorts including subjects with at least 2 visits (pre/post immunization).

https://doi.org/10.1371/journal.pone.0118283.t004

New Onset Cardiac Symptoms following Smallpox or Influenza Vaccine

The incidence of new onset cardiac symptoms following immunization with SPX and TIV is shown in Table 5. Despite no significant differences in pre-vaccine health self-assessment between the cohorts and fewer reported physical limitations in the SPX cohort, there was a significantly higher incidence of new onset cardiac symptom(s) post-SPX (10.6%) compared to post-TIV (2.6%), p<0.001. In univariate analysis, current/recent smoking status, presence of physical limitations and a lower self-reported health assessment were significantly associated with the onset of new cardiac symptoms post-vaccination (detailed in Table 6). Controlling for group differences in age, sex, weight, race, smoking, and physical limitations, the risk of having one or more new onset cardiac symptoms was greater following SPX than after TIV (adjusted relative risk (adjRR) 4.9, 95% CI: 1.9–12.8). This difference persisted when only new onset cardiac symptoms with severity of 3 or greater on the 10 point visual analogue scale were evaluated after adjusting for baseline variables (adjRR 5.4, 95% CI: 1.6–18.1). It is noteworthy that the most commonly reported new onset (possible) cardiac associated symptoms post-SPX are chest pain and dyspnea on exertion.

thumbnail
Table 5. Frequency of new onset cardiac symptoms day 4–30 after immunization with smallpox (SPX) versus trivalent inactivated influenza vaccines (TIV).

https://doi.org/10.1371/journal.pone.0118283.t005

thumbnail
Table 6. Characteristics of subjects with and without new onset cardiac symptoms.

https://doi.org/10.1371/journal.pone.0118283.t006

Myocarditis/Pericarditis Incidence Post-Immunization

The TIV cohort (n = 189) had no cases of clinical or subclinical MP following immunization (incidence rate 0 per 100,000 (95% CI (0–1952)). In contrast, within the SPX cohort (n = 1081) there were five cases of new onset clinical MP: pericarditis (1), myocarditis (4). All the myocarditis cases were Caucasian males (1 pericarditis case was female), consistent with the demographics of cases previously published [3, 4]. The myocarditis/pericarditis incidence rate for the post-SPX cohort was 463 per 100,000 (95% CI 150–1079 per 100,000). Only two of the five cases sought acute medical care outside of the protocol visits and 3 cases were identified by new onset cardiac symptoms (without seeking acute evaluation) and associated cTnT elevations (peak values 0.05–0.357 ng/ml) with pre-vaccine levels <0.01 ng/ml. As shown in Table 7, when compared to the published background rate of MP in a comparable population of service members not exposed to SPX immunization (detailed in Table 3)[3], the relative risk of clinical MP was 214 fold higher (95% CI (65–558); p<0.001) than the published background rate. It is noteworthy that the epidemiologic retrospective post-SPX rate was 7.5 fold higher than the background rate compared to 214-fold higher rate in this prospective SPX study [3].

thumbnail
Table 7. Prospective Cases of New Onset Myocarditis/Pericarditis or cTnT Elevation Following Immunization with Either Smallpox or Trivalent Influenza Vaccine.

https://doi.org/10.1371/journal.pone.0118283.t007

Subclinical Myocarditis/Pericarditis Incidence

Possible subclinical myocarditis incidences for SPX and TIV cohorts were based on data from subjects with cTnT measurements at visit 1 (pre-vaccine) and at least one post-vaccine visit showing a dynamic change from baseline that met the case definition. In the absence of new onset cardiac symptoms, 31 (96.8% male) subjects in the SPX cohort demonstrated elevations in cTnT post immunization that met our first criteria for subclinical MP (<0.01 ng/ml pre-immunization with post-vaccine level ≥0.02 ng/ml). These elevated cTnT observations occurred predominantly between days 6 and 13 post-vaccination (median 10 days, range 6–28). In comparison to the SPX cohort, the post-immunization incidence rate of comparable cTnT elevations in the TIV cohort was zero (p = 0.01).

The absolute subclinical cTnT elevations post SPX vaccine ranged from 0.02 to 0.24 ng/ml with the majority (n = 28, 90.3%) ranging from 0.02 to 0.07 ng/ml. All elevations normalized in the 3rd visit if data were available. No subclinical pericarditis cases (based on diagnostic ECG changes post vaccine) were identified. Three subjects had cTnT elevations ≥ 0.10 ng/ml (0.10, 0.10, 0.24 ng/ml) without cardiac symptoms.

The frequency of new elevations of cTnT post-SPX (and meeting our postulated case definition for possible subclinical myocarditis) was significantly greater than in the post-TIV group (p = 0.016) as detailed in Table 7. Relative risk could not be calculated because there were no occurrences in the TIV immunized group.

The majority of MP cases (except one case of pericarditis) and possible subclinical MP were Caucasian males receiving the vaccine for the first time. All MP and subclinical MP signs and symptoms resolved spontaneously with conservative management.

Discussion

This manuscript describes the first prospective post-licensure study, using surveillance time points correlating with peak windows of post-vaccine systemic clinical symptoms and increases in immune activation/inflammation biomarkers [17], to define the incidence of both clinical MP and possible subclinical (without cardiac symptoms) cardiac injury following SPX immunization. Utilizing active surveillance, we identified a significantly higher incidence (463 per 100,000) of clinical MP (compared to previously published background rates in a comparable population). Prior to the present study, the incidence of MP following smallpox vaccination was estimated from passive surveillance registries and population databases, with an inherent bias towards underestimation of disease incidence. For example, MP or cardiac adverse events were not identified in the smallpox vaccination experience of the Israeli Defense Force or in a review of the U.S. experience with SPX immunization in the 1970s [1819]. However, older studies from northern European countries suggested a link between smallpox vaccine and MP [2022]. The estimates of incidence rates for MP were significantly underestimated in early reports on the SPX program [2324].

Our study is the first to prospectively define the incidence of new onset cardiac symptoms in temporal association with SPX and TIV immunization. Despite no significant differences in pre-vaccine health self-assessment between the cohorts, and fewer reported physical limitations in the SPX cohort, there was a significantly higher incidence (4-fold) of new onset cardiac symptom(s) post-SPX (10.6%) compared to post-TIV (2.6%). This difference suggests a unique association with vaccinia immunization. The peak immune inflammatory activation pattern following SPX vaccine occurs between day 8–9 (with a range of day 4–27) post-SPX and includes a predominantly Th1 cytokine pattern (interferon-γ, tumor necrosis factor-α, interferon-inducible protein-10, interleukin-6, granulocyte/granulocyte-macrophage-colony-stimulating-factor, etc.) [17]. These cytokine elevations mirrored our observed timeline for peak incidence of cTnT elevations, new onset cardiac symptoms and cases of MP, suggesting inflammation as the mechanistic link to the elevated troponins as well as symptoms. Other physical symptoms following SPX have been correlated to various cytokine elevation patterns [17, 2526]. While no studies have as yet identified genetic risk biomarkers for the development of myocarditis, cardiac symptoms or troponin release injury post immunization, other adverse events or systemic symptoms have been linked to genetic polymorphism in the cytokine gene for IL4 [26].

The strengths of this study included baseline comparisons for each subject’s post-vaccine measures and a robust analysis that controlled for other baseline differences between vaccinated groups. The consistency among SPX and TIV cohort participants with an occupationally related physical fitness requirement ensured a reasonable expectation of pre-vaccine cardiovascular health. Additionally, the independent review of MP cases by cardiologists experienced in myocarditis, blinded ECG interpretations, and serial clinical evaluations minimized any potential for confirmation bias.

One explanation for the potential underestimation of the true incidence of MP in healthy, physically active populations (with a low risk of coronary artery disease), regardless of cause, is the clinical bias that chest pain would more likely be interpreted as musculoskeletal (e.g., myalgias) or part of “body aches.” For example, symptom diary data from 1000 civilian laboratory workers receiving SPX did not mention chest pain [23]. Because of the infrequent use of endomyocardial biopsy, the true incidence of histologically confirmed myocarditis in the general population is not known [24]. Evolving understanding of clinically significant troponin levels may explain prior lower rates of MP clinical diagnosis [2729].

Unlike Ahlborg’s earlier study in military recruits [20], our study did not identify any subclinical cases of pericarditis through serial ECGs. Given the population of healthy active subjects enrolled, there were a high number of abnormal readings that were ultimately identified as normal variants due to early repolarization. The fact that the ECG serial monitoring did not identify additional potential “subclinical cases” is consistent with the published report by Sano et al. [30].

The use of dynamic cTnT changes before and after immunization as a surrogate biomarker for a case definition of possible subclinical myocarditis has not been used previously. A review of the next generation modified vaccinia Ankara vaccine studies measured pre-post changes at the 14 day time-point but did not develop such a standardized case definition nor did it address using the subject as their own control to define dynamic changes, focusing on clinical case detection alone [31]. These studies also did not focus on timing of measurements in parallel to potential peak immune responses when inflammatory stressors might trigger a cardiac reaction. While assumptions about benign troponin release from the myocardium have been made, there is a growing body of literature suggesting that even in generally healthy populations with no known cardiac disease risk, small elevations in troponin (stratified below the levels measured by the assay in this study) are associated with increased risk of all cause and cardiovascular mortality [14, 15, 3236]. Therefore, the rate of reported elevations in this study may actually be an underestimate of the true incidence of vaccine related subclinical myocarditis.

The Global Task Force Guidelines for the Application of the Universal Definition of Myocardial Infarction defines the diagnostic troponin level for acute cardiac injury as ≥99th percentile of the upper-reference-limit which, for the cTnT assay used in this study, is <0.01 ng/ml [33]. Recent publications indicate there is clinical significance for levels below this value (in the less than 10 picogram/ml ranges) when higher sensitivity assays are used [12, 3436]. There is no defined threshold for the diagnosis of myocarditis. Reports with myocardial biopsy data suggest lower cTnT thresholds in order to optimize diagnostic sensitivity for acute myocarditis [28]. In a report by Lauer et al, 44% of patients with cTnT levels below 0.10 ng/ml had evidence (histologic or immunohistologic or both) of myocarditis on endomyocardial biopsy, and cTnT levels for all patients with histologic evidence of myocarditis suggested a clustering of cases between undetectable and 0.10 ng/ml [29]. None of these studies involved cohorts that were asymptomatic.

This is the first report providing a case definition for possible subclinical myocarditis along with an estimate of the incidence rate in a SPX immunized cohort. However, the specificity as well as sensitivity of the proposed case definition remains to be validated with open questions about the long-term prognosis or pathogenesis. While the disease confounders usually associated with troponin elevations [15] are not known to be present in the study populations, the cause for the troponin release could be attributed to other causes. However, Wallace et al. [12,15] showed that in an older population than ours, free of diabetes mellitus, hypertension, chronic kidney disease, left ventricular hypertrophy, congestive heart failure, history of myocardial infarction, low ejection fraction or BMI>30 (n = 1060), no subjects were observed with detectable cTnT (>0.01 ng/ml). The fact that there were no changes in the TIV group supports that whatever the mechanism, it remains probable that the transient troponin elevations are linked to the immune activating stressors associated with the SPX vaccination. Cardiac myosin molecule is a dominant auto-antigen in animal models of myocarditis, presumably after release from the injured heart, and raises additional questions about the long-term risks of cardiac troponin release [37]. Inflammatory cytokine pathways, activated by SPX immunization, have been associated with cardiac inflammation [38, 39]. Given the patchy nature of myocarditis and the benign clinical course in the post-vaccine MP cases, cardiac biopsies would not necessarily have been helpful and would not be clinically indicated (benefit-risk for such an invasive procedure could not ethically be justified).

A limitation of the study is the small size of the TIV cohort relative to the SPX cohort, which limited our ability to precisely estimate the adjusted relative risk of clinical and possible subclinical MP following influenza immunization. However, based on the limited published case reports of MP following TIV [40, 41], the incidence must be very rare and not clearly defined as increased compared to the background rate of disease presentation. Again, a balancing strength for the smaller TIV cohort size is the use of each subject as their own control.

The dynamic change in cTnT levels post SPX vaccine may reflect underlying subclinical cardiovascular disease as well as myocarditis given the growing evidence that atherosclerotic/ischemic cardiovascular disease progression also involves immune inflammatory mechanisms [39]. This study raises the question whether or not inflammation in response to primary SPX immunization or other conditions that stimulate immune activation represent a new “stress test” that unmasks ischemic disease versus non-ischemic inflammatory myocarditis. The population studied was a healthy and physically active group of young men and women and would be expected to have a low risk of ischemic cardiovascular disease. It is noteworthy that Eckart et al. did not show any epidemiologic evidence of increased acute atherosclerotic cardiovascular events in the 30 day period following SPX immunization in a comparable study population [42]. In contrast, Jacobson et al. showed that there is an increased risk for hospitalization post-smallpox vaccine with the highest hazard ratios associated with coding combinations for inflammatory (non-atherosclerotic) cardiac disease [43]. The long term risk of cardiovascular disease with transient elevations of cTnT in our study population remains to be defined.

The confounder of exercise related changes in cTnT measurements is an unlikely limitation. cTnT levels may be elevated after intense exercise but controversy exists as to the long-range clinical implications and, whether these are benign physiologic changes or a marker of poor prognosis [4449]. This study was not designed to specifically quantify exercise in temporal association with the visits and this may be considered another limitation for accurately defining the significance of cTnT elevations post-SPX. The fact that no changes were seen in a healthy, active TIV immunized population further supports that there is a specific effect in SPX-vaccinees that causes transient cardiac muscle injury. High-sensitivity cTnT studies of pre-post exercise stress testing in patients with potential cardiovascular disease only show small increases in cTnT (in the less than 10 picogram range per ml) and this biomarker was associated with future prognostic risk. Picogram range elevations would not have been detected in the assay used for this study [36, 4951].

It is noteworthy that the publication by Elizaga et al. [52], reporting on cardiac adverse events in healthy subjects receiving modified vaccinia Ankara vaccines, does not address the type of troponin I assay used or definition for elevation. In addition, the timing of post-vaccine testing was beyond the window of peak detection identified in our study. As troponin assay technology and prognostic significance continue to evolve, there is a need for standardized guidelines for their use within drug and vaccine safety surveillance studies. Defining long-term cardiac morbidity and mortality risk resulting from adverse drug reactions remains a significant challenge for post-licensure safety surveillance.

Our study identified a rate of myocarditis/pericarditis following SPX immunization that is significantly higher than previously described, and highlights the challenges of post-licensure vaccine safety surveillance to identify adverse events that are not well understood or previously unrecognized. Applying the incidence described in this study to a SPX immunization program that has delivered over 2 million doses, largely to young, healthy primary vaccinees, there are potentially thousands of vaccine associated cases, many undiagnosed because of self-medication or lack of provider awareness [53]. In our study, 3 of the 5 clinical cases would not have sought medical care without study interventions including enhanced education and surveillance. The recognition of potential adverse events following immunization requires accurate diagnosis of new onset clinical symptoms. Our study reinforces the need, as part of all post-vaccine (and potentially new drug related) adverse events surveillance, to include specific standardized inquiry about new onset cardiac symptoms and to highlight the value of dynamic pre to post immunization cardiac troponin increases as a potential biomarker of risk in future safety surveillance studies.

Acknowledgments

This work is dedicated with deep respect to our service members and beneficiaries, with special thanks to the Vaccine Healthcare Centers Network Myocarditis/Pericarditis Clinical Case Management Consortium: Walter Reed (Lorne McCoy, Jennifer Mbuthia, Laurie Duran, Jeannette Williams, Mary Minor, Dacia Murray, Wayne Scott, Kaureen Langlie, Connie Lohsl, Stephanie Ryder, Denece Clayborne, Christina Armstrong, James Farr); Womack Army Medical Center (Nancy Blacker, Jacqueline Cardenas, Nora Rachels, Amy McCoart, Joseph Weagraff, Mary Hussain, DeLisa Crosby, Amanda Williams); Naval Medical Center Portsmouth (Jay Montgomery, Mary Frances Allan-Martinez, Ann Morse); Wilford Hall Medical Center (David Hrncir, Catherine Skerrett, Molly Hartshorn, Yvonne Lopez, Claudia Glass).

Additional acknowledgements online: cardiologists (Dimitri Cassimatis, Michael Rave, Richard Malish, Jeffrey Johnson, Joseph Johnson, Robert Eckart, Eric A. Shry, Peter Linz); Walter Reed National Military Medical Center Department of Research Programs (LTC Mary M. Klote); Henry M. Jackson Foundation for the Advancement of Military Medicine (Norman Gardner, Lizabeth Reilly-Hess). This work could not have been accomplished without the support of the now historic Walter Reed Army Medical Center (1902–2011) leadership and staff. Additional thanks: Northern California Kaiser Vaccine Research Unit, particularly Ned Lewis and Joanie Johnson; CDC: Brigid Batten, Claudia Vellozzi; Brian Viggiano; and the Clinical Immunization Safety Assessment Network; Brooke Army Medical Center Pathology Laboratory (Karen K. Nauschuetz, Felix Duelm, Lu Lazenberry).

Disclaimer

The views expressed in this article are those of the authors and do not necessarily reflect the official policy or position of the Department of the Army / Navy / Air Force, Department of Defense, nor the U.S. Government.

Author Contributions

Conceived and designed the experiments: RJME MRN LCC BAH BTG JEA RLD MNV SB CW. Performed the experiments: RJME MRN LCC BMM JEA BTG BAH DGG DLC. Analyzed the data: ASC RSH. Wrote the paper: RJME MRN LCC CS BAH BTG JEA RSH DLC ASC DGG MNV MSL BMM CW ASJ LTC CC RLD SB. Interpretation of data: RJME MRN LCC CS BAH BTG JEA DLC DGG MNV MSL BMM ASJ LTC SB CC RLD. Significant input and critical support for data analysis: RJME CS MRN CC RLD.

References

  1. 1. Smallpox Vaccine Doses Data obtained from the Armed Forces Health Surveillance Center (AFHSC: www.afhsc.mil/home): Defense Medical Surveillance System (DMSS)/Defense Enrollment Eligibility Registry System (DEERS) Immunization Registry: 14 March 2012.
  2. 2. Nalca A, Zumbrun EE. ACAM2000: the new smallpox vaccine for United States Strategic National Stockpile. Drug Des Devel Ther. 2010 May 25; 4:71–9. pmid:20531961
  3. 3. Arness MK, Eckart RE, Love SS, Atwood JE, Wells TS, Engler RJ, et al. Myo/pericarditis following smallpox vaccination. Am J Epidemiol. 2004 Apr; 160(7):642–51. pmid:15383408
  4. 4. Eckart RE, Love SS, Atwood JE, Arness MK, Cassimatis DC, Campbell CL, et al. and the Department of Defense Smallpox Vaccination Clinical Evaluation Team. Incidence and follow-up of inflammatory cardiac complications after smallpox vaccination. J Am Coll Cardiol. 2004 Jul;44(1):201–5. pmid:15234435
  5. 5. Smallpox Vaccine. Vaccines and Related Biological Products Advisory Committee (VRBPAC) Briefing Document, 18 April 2007. Available: www.fda.gov/ohrms/dockets/ac/07/briefing/2007-4292b2-02.pdf. Accessed 2012 Oct 4.
  6. 6. Varricchio F, Iskander J, Destefano F, Ball R, Pless R, Braun MM, et al. Understanding vaccine safety information from the Vaccine Adverse Event Reporting System. Pediatr Infect Dis J. 2004 Apr;23(4):287–94. pmid:15071280
  7. 7. McMahon AW, Zinderman C, Ball R, Gupta G, Braun MM. Comparison of military and civilian reporting rates for smallpox vaccine adverse events. Pharmacoepidemiol Drug Saf. 2007;16(6):597–604. pmid:17154344
  8. 8. Memorandum for Secretaries of the Military Departments, Chairman of the Joint Chiefs of Staff, Under Secretaries of Defense, General Counsel of the Department of Defense, Directors of Defense Agencies, Commandant of the U.S. Coast Guard: Subject: Update to Clinical Policy for the Department of Defense Smallpox Vaccination Program; dated April 1, 2008, HA Policy 08–004. Available: www.vaccines.mil/documents/1182SPX_Update_Clinical_Policy.pdf. Accessed 2013 Jul 30.
  9. 9. Rautaharju PM, Surawicz B, Gettes LS, Bailey JJ, Childers R, Deal BJ, et al. American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; American College of Cardiology Foundation; Heart Rhythm Society. AHA/ACCF/HRS Recommendations for the Standardization and Interpretation of the Electrocardiogram, Part IV: The ST Segment, T and U Waves and the QT Interval: a scientific statement from the American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; the American College of Cardiology Foundation; and the Heart Rhythm Society. Endorsed by the International Society for Computerized Electrocardiology. J Am Coll Cardiol 2009 Mar 17;53(11):982–91. pmid:19281931
  10. 10. Apple FS, Quist HE, Doyle PJ, Otto AP, Murakami MM. Plasma 99th percentile reference limits for cardiac troponin and creatine kinase MB mass for use with European Society of Cardiology/American College of Cardiology consensus recommendations. Clin Chem 2003 Aug; 49(8):1331–6. pmid:12881449
  11. 11. Zarich SW, Bradley K, Mayall ID, Bernstein LH. Minor elevations in troponin T values enhance risk assessment in emergency department patients with suspected myocardial ischemia: analysis of novel troponin T cut-off values. Clin Chim Acta. 2004 May; 343(1–2):223–9. pmid:15115702
  12. 12. Wallace TW, Abdullah SM, Drazner MH, Das SR, Khera A, McGuire DK, et al. Prevalence and determinants of troponin T elevation in the general population. Circulation 2006 Apr 25,113(16):1958–1965. pmid:16618821
  13. 13. Thygesen K, Mair J, Katus H, Plebani M, Venge P, Collinson P, et al.; Study Group on Biomarkers in Cardiology of the ESC Working Group on Acute Cardiac Care. Recommendations for the use of cardiac troponin measurement in acute cardiac care. Eur Heart J. 2010 Sep;31(18):2197–204. pmid:20685679
  14. 14. de Lemos JA, Drazner MH, Omland T, Ayers CR, Khera A, Rohtagi A, et al. Association of troponin T detected with a highly sensitive assay and cardiac structure and mortality risk in the general population. JAMA 2010 Dec 8;304(22):2503–12. pmid:21139111
  15. 15. de Lemos JA. Increasingly sensitive assays for cardiac troponins: a review. JAMA 2013 Jun 5;309(21):2262–9. pmid:23736735
  16. 16. Morgan J, Roper MH, Sperling L, Schieber RA, Heffelfinger JD, Casey CG, et al. Myocarditis, pericarditis, and dilated cardiomyopathy after smallpox vaccination among civilians in the United States, January-October 2003. Clin Infect Dis. 2008 Mar 15;46 Suppl 3:S242–50. pmid:18284365
  17. 17. Cohen JI, Hohman P, Fulton R, Turk SP, Quin J, Thatcher K, et al. Kinetics of serum cytokines after primary or repeat vaccination with the smallpox vaccine. J Infect Dis. 2010 Apr 15;15;201(8):1183–91. pmid:20214479
  18. 18. Haim M, Gdalevich M, Mimouni D, Ashkenazi I, Shemer J. Adverse reactions to smallpox vaccine: the Israel Defense Force experience, 1991 to 1996. A comparison with previous surveys. Mil Med. 2000 Apr;165(4):287–9. pmid:10803002
  19. 19. Lane JM, Goldstein J. Evaluation of 21st-Century Risks of Smallpox Vaccination and Policy Options. Ann Intern Med 2003 Mar 18;138(6):488–493. pmid:12639083
  20. 20. Ahlborg B, Linroth K, Nordgren B. ECG changes without subjective symptoms after smallpox vaccination of military personnel. Acta Med Scand Suppl. 1966; 464:127–134. pmid:5229008
  21. 21. Karjalainen J, Heikkilä J, Nieminen MS, Jalanko H, Kleemola M, Lapinleimu , et al. Etiology of mild acute infectious myocarditis. Relation to clinical features. Acta Med Scand. 1983;213(1):65–73. pmid:6829323
  22. 22. Friman G. The incidence and epidemiology of myocarditis. Eur Heart J 1999 Aug; 20(15):1063–66. pmid:10413634
  23. 23. Baggs J, Chen RT, Damon IK, Rotz L, Allen C, Fullerton KE, et al. Safety profile of smallpox vaccine: insights from the laboratory worker smallpox vaccination program. Clin Infect Dis. 2005 Apr 15; 40(8):1133–40. pmid:15791513
  24. 24. Sniadack MM, Neff LJ, Swerdlow DL, Schieber RA, McCauley MM, Mootrey GT. Follow-up of Cardiovascular Adverse Events after Smallpox Vaccination among civilians in the United States, 2003. Clin Infect Dis 2008 Mar; 46: Suppl 3:S251–7. pmid:18284366
  25. 25. Reif DM, McKinney BA, Motsinger AA, Chanock SJ, Edwards KM, Rock MT, et al. Genetic basis for adverse events after smallpox vaccination. J Infect Dis. 2008 Jul 1;198(1):16–22. pmid:18454680
  26. 26. Reif DM, Motsinger-Reif AA, McKinney BA, Rock MT, Crowe JE Jr, Moore JH. Integrated analysis of genetic and proteomic data identifies biomarkers associated with adverse events following smallpox vaccination. Genes Immun. 2009 Mar;10(2):112–9. pmid:18923431
  27. 27. Sagar S, Liu PP, Cooper LT. Myocarditis. Lancet 2012 Feb 25;379:738–747. pmid:22185868
  28. 28. Soongswang J, Durongpisitkul K, Nana A, Laohaprasittiporn D, Kangkagate C, Punlee K, et al. Cardiac troponin T: a marker in the diagnosis of acute myocarditis in children. Pediatr Cardiol. 2005 Jan-Feb;26:45–9. pmid:15793653
  29. 29. Lauer B, Niederau C, Kuhl U, Schannwell M, Pauschinger M, Strauer BE, et al. Cardiac troponin T in patients with clinically suspected myocarditis. J Am Coll Cardiol 1997 Nov 1;30(5):1354–9. pmid:9350939
  30. 30. Sano J, Chaitman BR, Swindle J, Frey SE. Electrocardiography screening for cardiotoxicity after modified Vaccinia Ankara vaccination. Am J Med. 2009 Jan 1;122(1):79–84. pmid:19114175
  31. 31. Elizaga ML, Vasan S, Marovich MA, Sato AH, Lawrence DN, Chaitman BR, et al.; MVA Cardiac Safety Working Group. Prospective surveillance for cardiac adverse events in healthy adults receiving modified vaccinia Ankara vaccines: a systematic review. PLoS One. 2013;8(1):e54407. Available: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3547923/pdf/pone.0054407.pdf. Accessed 2013Aug 30.
  32. 32. Cramer GE, Brouwer MA, Vader HL, de Boer MJ, Pop GA, Pop VJ, et al. Highly sensitive cardiac troponin T and long-term mortality in a population of community-derived perimenopausal women: nested case-control study. Heart. 2013 Apr;99(8):528–33. pmid:23315610
  33. 33. Thygesen K, Alpert JS, Jaffe AS, Simoons ML, Chaitman BR, White HD. Joint ESC/ACCF/AHA/WHF Task Force for the Universal Definition of Myocardial Infarction. Third universal definition of myocardial infarction. Circulation. 2012;126:2020–2035. Available: http://www.escardio.org/guidelines-surveys/esc-guidelines/GuidelinesDocuments/guidelines-universal-MI-slides.pdf. Accessed 2013 Oct 1.
  34. 34. Sabatine MS, Morrow DA, de Lemos JA, Jarolim P, Braunwald E. Detection of acute changes in circulating troponin in the setting of transient stress test-induced myocardial ischaemia using an ultrasensitive assay: results from TIMI 35. Eur Heart J. 2009 Jan;30(2):162–9. pmid:18997177
  35. 35. Babuin L, Vasile VC, Rio Perez JA, Alegria JR, Chai HS, Afessa B, et al. Elevated cardiac troponin is an independent risk factor for short- and long-term mortality in medical intensive care unit patients. Crit Care Med 2008 Mar; 36(3):759–765. pmid:18209672
  36. 36. Oluleye OW, Folsom AR, Nambi V, Lutsey PL, Ballantyne CM; ARIC Study Investigators. Troponin T, B-type natriuretic peptide, C-reactive protein, and cause-specific mortality. Ann Epidemiol. 2013 Feb;23(2):66–73. pmid:23228375
  37. 37. Mascaro-Blanco A, Alvarez K, Yu X, Lindenfeld J, Olansky L, Lyons T, et al. Consequences of unlocking the cardiac myosin molecule in human myocarditis and cardiomyopathies. Autoimmunity 2008 Sep; 41(6):442–53. pmid:18781470
  38. 38. Rose NR. Critical cytokine pathways to cardiac inflammation. J Interferon Cytokine Res. 2011 Oct; 31(10):705–10. pmid:21861699
  39. 39. Libby P, Lichtman AH, Hansson GK. Immune effector mechanisms implicated in atherosclerosis: from mice to humans. Immunity. 2013 Jun 27;38(6):1092–104. pmid:23809160
  40. 40. Kao CD, Chen JT, Lin KP, Shan DE, Wu ZA, Liao KK. Guillain-Barré syndrome coexisting with pericarditis or nephrotic syndrome after influenza vaccination. Clin Neurol Neurosurg. 2004 Mar;106(2):136–8. pmid:15003306
  41. 41. de Meester A, Luwaert R, Chaudron JM. Symptomatic pericarditis after influenza vaccination: report of two cases. Chest. 2000 Jun;117(6):1803–5. pmid:10858422
  42. 42. Eckart RE, Shry EA, Atwood JE, Brundage JF, Lay JC, Bateson TF, et al. Smallpox vaccination and ischemic coronary events in healthy adults. Vaccine 2007 Dec 5;25(50):8359–64. pmid:17981378
  43. 43. Jacobson IG, Smith TC, Smith B, Wells TS, Reed RJ, Ryan MA. US military service members vaccinated against smallpox in 2003 and 2004 experience a slightly higher risk of hospitalization post-vaccination. Vaccine. 2008 Jul 29;26(32):4048–56. pmid:18586364
  44. 44. Shave R, Baggish A, George K, Wood M, Scharhag J, Whyte G, et al. Exercise-induced cardiac troponin elevation: evidence, mechanisms, and implications. J Am Coll Cardiol. 2010 Jul 13;56(3):169–76. pmid:20620736
  45. 45. Harper RW. Exercise-induced troponin elevation: not necessarily a benign phenomenon. J Am CollCardio 2010 Dec 14; 56(25):2145.
  46. 46. Regwan S, Hulten EA, Martinho S, Slim J, Villines TC, Mitchell J, et al. Marathon running as a cause of troponin elevation: a systematic review and meta-analysis. J Interv Cardiol. 2010 Oct;23(5):443–50. pmid:20663014
  47. 47. Baker P, Davies SL, Larkin J, Moult D, Benton S, Roberts A, et al. Changes to the cardiac biomarkers of non-elite athletes completing the 2009 London Marathon. Emerg Med J. 2014 May;31(5):374–9. pmid:23513235
  48. 48. Tian Y, Nie J, Huang C, George KP. The kinetics of highly sensitive cardiac troponin T release after prolonged treadmill exercise in adolescent and adult athletes. J Appl Physiol. 2012 Aug;113(3):418–25. pmid:22653984
  49. 49. deFilippi CR, de Lemos JA, Tkaczuk AT, Christenson RH, Carnethon MR, Siscovick DS, et al. Physical activity, change in biomarkers of myocardial stress and injury, and subsequent heart failure risk in older adults. J Am Coll Cardiol. 2012 Dec 18;60(24):2539–47. pmid:23158528
  50. 50. Falkensammer J, Gasteiger S, Stojakovic T, Stühlinger M, Scharnagl H, Frech A, et al. Elevated baseline hs-cTnT levels predict exercise-induced myocardial ischemia in patients with peripheral arterial disease. Clin Chim Acta. 2012 Dec 18;413(19–20):1678–82.
  51. 51. Pervanidou P, Akalestos A, Bastaki D, Apostolakou F, Papassotiriou I, Chrousos G. Increased circulating High-Sensitivity Troponin T concentrations in children and adolescents with obesity and the metabolic syndrome: a marker for early cardiac damage? Metabolism. 2013 Apr;62(4):527–31. pmid:23114876
  52. 52. Elizaga ML, Vasan S, Marovich MA, Sato AH, Lawrence DN, Chaitman BR, et al.; MVA Cardiac Safety Working Group. Prospective surveillance for cardiac adverse events in healthy adults receiving modified vaccinia Ankara vaccines: a systematic review. PLoS One. 2013;8(1):e54407. pmid:23349878
  53. 53. Montgomery JR, Engler R, Allan-Martinez F, Morse A, Duran L. Case report: Chest pain in service members following smallpox vaccination. MSMR. 2012 Mar;19(3):6–7. pmid:22452714