Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Development of a standardized MRI protocol for pancreas assessment in humans

  • John Virostko ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Software, Writing – original draft, Writing – review & editing

    jack.virostko@austin.utexas.edu

    Affiliations Department of Diagnostic Medicine, University of Texas at Austin, Austin, Texas, United States of America, Livestrong Cancer Institutes, University of Texas at Austin, Austin, Texas, United States of America, Department of Oncology, University of Texas at Austin, Austin, Texas, United States of America

  • Richard C. Craddock,

    Roles Formal analysis, Software, Writing – review & editing

    Affiliation Department of Diagnostic Medicine, University of Texas at Austin, Austin, Texas, United States of America

  • Jonathan M. Williams,

    Roles Investigation, Writing – review & editing

    Affiliation Division of Diabetes, Endocrinology, and Metabolism, Department of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America

  • Taylor M. Triolo,

    Roles Formal analysis, Investigation, Writing – review & editing

    Affiliation Barbara Davis Center for Diabetes, University of Colorado School of Medicine, Aurora, Colorado, United States of America

  • Melissa A. Hilmes,

    Roles Formal analysis, Writing – review & editing

    Affiliations Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America, Department of Pediatrics, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America

  • Hakmook Kang,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Department of Biostatistics, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America

  • Liping Du,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Department of Biostatistics, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America

  • Jordan J. Wright,

    Roles Formal analysis, Writing – review & editing

    Affiliation Division of Diabetes, Endocrinology, and Metabolism, Department of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America

  • Mara Kinney,

    Roles Investigation, Writing – review & editing

    Affiliation Barbara Davis Center for Diabetes, University of Colorado School of Medicine, Aurora, Colorado, United States of America

  • Jeffrey H. Maki,

    Roles Formal analysis, Writing – review & editing

    Affiliation Department of Radiology, University of Colorado School of Medicine, Aurora, Colorado, United States of America

  • Milica Medved,

    Roles Investigation, Writing – review & editing

    Affiliation Department of Radiology, University of Chicago, Chicago, IL, United States of America

  • Michaela Waibel,

    Roles Investigation, Writing – review & editing

    Affiliation Immunology and Diabetes Unit, St Vincent’s Institute, Fitzroy, Victoria, Australia

  • Thomas W. H. Kay,

    Roles Investigation, Writing – review & editing

    Affiliations Immunology and Diabetes Unit, St Vincent’s Institute, Fitzroy, Victoria, Australia, Department of Medicine, St. Vincent’s Hospital, The University of Melbourne, Fitzroy, Victoria, Australia

  • Helen E. Thomas,

    Roles Investigation, Writing – review & editing

    Affiliations Immunology and Diabetes Unit, St Vincent’s Institute, Fitzroy, Victoria, Australia, Department of Medicine, St. Vincent’s Hospital, The University of Melbourne, Fitzroy, Victoria, Australia

  • Siri Atma W. Greeley,

    Roles Conceptualization, Investigation, Writing – review & editing

    Affiliation Section of Adult and Pediatric Endocrinology, Diabetes, and Metabolism, Kovler Diabetes Center, University of Chicago, Chicago, IL, United States of America

  • Andrea K. Steck,

    Roles Investigation, Writing – review & editing

    Affiliation Barbara Davis Center for Diabetes, University of Colorado School of Medicine, Aurora, Colorado, United States of America

  • Daniel J. Moore,

    Roles Conceptualization, Formal analysis, Investigation, Writing – original draft, Writing – review & editing

    Affiliations Department of Pediatrics, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America, Department of Pathology, Immunology, and Microbiology, Vanderbilt University, Nashville, Tennessee, United States of America

  •  [ ... ],
  • Alvin C. Powers

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Writing – original draft, Writing – review & editing

    Affiliations Division of Diabetes, Endocrinology, and Metabolism, Department of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America, Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee, United States of America, VA Tennessee Valley Healthcare System, Nashville, Tennessee, United States of America

  • [ view all ]
  • [ view less ]

Abstract

Magnetic resonance imaging (MRI) has detected changes in pancreas volume and other characteristics in type 1 and type 2 diabetes. However, differences in MRI technology and approaches across locations currently limit the incorporation of pancreas imaging into multisite trials. The purpose of this study was to develop a standardized MRI protocol for pancreas imaging and to define the reproducibility of these measurements. Calibrated phantoms with known MRI properties were imaged at five sites with differing MRI hardware and software to develop a harmonized MRI imaging protocol. Subsequently, five healthy volunteers underwent MRI at four sites using the harmonized protocol to assess pancreas size, shape, apparent diffusion coefficient (ADC), longitudinal relaxation time (T1), magnetization transfer ratio (MTR), and pancreas and hepatic fat fraction. Following harmonization, pancreas size, surface area to volume ratio, diffusion, and longitudinal relaxation time were reproducible, with coefficients of variation less than 10%. In contrast, non-standardized image processing led to greater variation in MRI measurements. By using a standardized MRI image acquisition and processing protocol, quantitative MRI of the pancreas performed at multiple locations can be incorporated into clinical trials comparing pancreas imaging measures and metabolic state in individuals with type 1 or type 2 diabetes.

Introduction

MRI plays an important role in the diagnosis and monitoring of a number of pancreatic disorders including chronic [1] and acute [2] pancreatitis, nonalcoholic fatty pancreas disease [3], and pancreatic cancer [4]. In addition, a number of quantitative MRI parameters are currently under investigation in the study of individuals with diabetes. For instance, MRI has demonstrated that pancreas volume is decreased in individuals with both type 1 [58] and type 2 diabetes [9,10], and may identify those at risk for developing diabetes. Longitudinal imaging in individuals with diabetes demonstrates dynamic changes in pancreas size, including declines over the natural history of type 1 diabetes [5] and increases in individuals with type 2 diabetes who respond to treatment [11]. These results suggest that MRI may have important applications in diabetes research and ultimately clinical management of the disease.

Most clinical MRI data of the pancreas is analyzed by visual inspection to identify features, such as mass lesions or edema, that are indicative of disease presence and severity. Radiomics offers a complementary approach, in which numerical features, some of which are directly related to physical or physiological properties of the imaged tissue, are extracted from the MRI data and evaluated mathematically. The advantage of this quantitative approach is that it can be sensitive to nuanced differences in images that are hard or impossible to detect visually. The clinical utility of quantitative imaging measures has been demonstrated across a number of diseases and organs of interest [12]. In the pancreas, quantitative evaluations of diffusion-weighted MRI has shown utility for characterizing pancreatic cancer [13], diagnosing pancreatitis [14], and identifying focal lesions in type 1 diabetes [5]. Two other quantitative MRI parameters, magnetization transfer ratio (MTR) and the longitudinal relaxation time (T1), have been implicated as markers of fibrosis [15,16] and may be altered in individuals with impaired glucose tolerance [17]. Measures of fat deposition in the liver have been shown to be sensitive to nonalcoholic fatty liver disease, which is a common comorbidity with type 2 diabetes [18]. Similarly, measures of pancreas fat may be associated with diabetes [19] and may correlate with therapeutic response [20].

While a variety of approaches have shown promise for pancreas imaging at single research sites, they have not been validated in multisite studies. Imaging of the brain [21] and solid tumors [22] has benefitted from multisite standardization. However, the pancreas is challenging to image, owing to its location deep within the abdomen, irregular borders, and the presence of motion and magnetic susceptibility artifacts. Thus, similar validation studies have not been performed for pancreas MRI. This represents a critical barrier for applying MRI of the pancreas to broader populations or to clinical trials. Furthermore, quantitative imaging measures can be influenced by technical factors that may vary across different types of MRI scanners, image acquisition parameters, and choice of image processing techniques. In order for quantitative parameters from pancreatic MRI to be implemented in multisite clinical trials, such as those performed by the Type 1 Diabetes TrialNet network and those in type 2 diabetes, standard image acquisition and processing protocols must be developed and validated. This study develops, validates, and makes available for universal use a multiparametric MRI protocol for pancreas imaging, which has been harmonized and assessed for reproducibility using phantoms and individuals at multiple imaging sites.

Materials and methods

MRI scanning protocol

The Multicenter Assessment of the Pancreas in Type 1 Diabetes (MAP-T1D) study is an international consortium of diabetes and medical imaging centers using MRI to investigate the pancreas in individuals with type 1 diabetes. The MAP-T1D team consists of five academic centers with different MRI hardware and software; including the University of Texas at Austin, subsequently referred to as Austin; Vanderbilt University Medical Center, subsequently referred to as Nashville; Barbara Davis Center for Diabetes and University of Colorado School of Medicine, subsequently referred to as Denver; University of Chicago, subsequently referred to as Chicago; St Vincent’s Institute and Hospital and the University of Melbourne, subsequently referred to as Melbourne. Two centers (Austin and Denver) were equipped with 3T Skyra scanners (Siemens, Erlangen, Germany). Scans performed in Melbourne were acquired using a 3T Prisma scanner (Siemens, Erlangen, Germany). Two centers (Nashville and Chicago) acquired images on 3T Ingenia scanners (Philips, Best, Netherlands). All Siemens scanners employed VE11C software. Of the Philips scanners, Vanderbilt employed R5.5.0.1 while Chicago employed R.5.6.1. All sites employed torso coil arrays.

The MRI protocol consisted of a three-plane localizer followed by a series of axial scans spanning the pancreas. Anatomical scans included fat-suppressed 3D T1-weighted gradient echo and T2-weighted fast spin-echo images with and without fat saturation. Diffusion-weighted MRI (DWI) was acquired in a single direction with spin-echo EPI readout and b-values of 0, 50, 200, and 800. For T1 mapping, a B1 field map was acquired to correct for transmit inhomogeneity followed by five spoiled gradient echo images with equally spaced flip angles spanning 4° to 20°. A gradient echo image with and without a magnetization transfer sensitive prepulse was acquired for calculation of MTR. A 3D quantitative 6-point Dixon acquisition was collected at sites which had the requisite software on their scanner (Austin, Nashville, Chicago, Melbourne). Imaging parameters are summarized in Table 1. With the exception of the B1 map, slice thickness was 4 mm. Total time for this protocol was approximately 16 minutes of acquisition time, translating to approximately 35 minutes of total scan time.

Phantom studies

Synthetic imaging phantoms for standardizing MRI parameters were constructed at a single center (Austin) and shipped to each site for imaging (Fig 1A). These MRI phantoms were used to standardize measurements of volume, apparent diffusion coefficient (ADC), T1, MTR, and fat fraction. For volume standardization, a pancreas phantom was generated from an abdominal MRI of a 39-year-old male with no known pancreas pathology. A 3D volume of the pancreas was extracted from the abdominal MRI by freehand tracing the organ’s borders using Osirix software (Pixmeo, Bernex, Switzerland). This volume was 3D printed using PLA thermoplastic and embedded in agar in a 1L Nalgene jar. For diffusion imaging, the phantom consisted of a 50 mL tube filled with deionized water chilled to 0°C and immobilized in a 1L Nalgene jar filled with ice water, as previously described [23]. Standardization of T1 measurements employed four phantoms consisting of Gadavist-doped gelatin in 50 mL tubes with prescribed T1 values of 500 ms, 1000 ms, 1250 ms, and 1500 ms. For MTR validation, crosslinked 15% bovine serum albumin was prepared as described previously [24]. The fat fraction phantom consisted of a 50 ml tube filled with canola oil. Phantoms assessing T1, MTR, and fat fraction were all placed in the same 1L Nalgene jar filled with room temperature water prior to imaging. The spatial orientation of each phantom during scanning was identical at each site. All phantom scans were completed within 60 days of one another.

thumbnail
Fig 1. Schematic of MRI data acquisition.

A) Example MRI of synthetic phantoms with calibrated properties that were shipped to five different sites for imaging. The phantom (upper left) consisted of three components. The leftmost bottle contained phantoms with canola oil, bovine serum albumin, and gadolinium-doped gelatin to validate fat fraction, MTR, and T1 measurements, respectively. Example fat fraction, MTR, and T1 maps are shown on the bottom row. The middle bottle contained a 3D printed pancreas created from an MRI of a normal volunteer pancreas and subsequently embedded in agar for imaging (middle row). The rightmost bottle contained deionized water chilled to 0°C to validate diffusion-weighted MRI measurements. B) Five healthy volunteers traveled to four sites in the US (Austin, Chicago, Denver, and Nashville) for an MRI of the pancreas using the harmonized acquisition protocol. C) MAP-T1D study logo.

https://doi.org/10.1371/journal.pone.0256029.g001

Volunteer studies

Five healthy volunteers with no known pancreas pathology or diabetes traveled to four MAP-T1D locations in the US (Austin, Chicago, Denver, Nashville) to undergo MRI using the standardized, harmonized imaging protocol (Fig 1B). The volunteers were not imaged at Melbourne because of travel distance. Characteristics of the volunteers were: four males and one female with an average age of 37 years old (min 31, max 44) with an average BMI of 26.4 ± 2.9 kg/m2. The time between the first and final MRI for each volunteer was 28, 28, 44, 64, and 79 days. These studies were approved by each site’s Institutional Review Board and performed in accordance with the guidelines and regulations set forth by the Human Research Protections Program. Written consent was provided by each research participant.

Image processing

Images of the phantoms and human volunteers were analyzed using the same methodology. The pancreas was outlined on each slice of the fat-suppressed T2-weighted image by an experienced radiologist (M.A.H.). Repeat scans of the same individual were blinded and presented to the radiologist non-consecutively to minimize bias. Pancreas outlining was performed using the Medical Image Processing, Analysis, and Visualization (MIPAV) application (https://mipav.cit.nih.gov/). The T1-weighted image was consulted to guide delineation of the pancreas border. Pancreas volume was calculated by multiplying the sum of the pancreas area on each slice by the distance between slices [25]. For human imaging, the pancreas volume was divided by the individual’s weight to yield the pancreas volume index (PVI) [5]. The surface area to volume ratio was calculated by summing the perimeter of each pancreas slice, multiplying by the distances between slices to yield surface area, and dividing by the pancreas volume. All image analysis was performed in MATLAB (The MathWorks, Natick, Massachusetts, R2019A).

ADC maps were calculated from the diffusion-weighted images acquired with b values of 200 and 800 s/mm2. ADC values were computed for each voxel by fitting the signal intensities to Eq 1: (1) where SI(b_high) and SI(b_low) are the signal intensities at b values of 800 and 200 s/mm2, respectively. T1 mapping was performed using a variable flip angle (VFA) technique, which is rapid, but prone to inaccuracies due to the B1 inhomogeneities commonly seen at higher fields [26]. To mitigate this issue, we employed a B1 correction map that quantifies the difference between the prescribed and actual flip angles at each voxel. B1-corrected T1 values were calculated for each voxel by fitting the signal intensity, S, data to Eq [2]: (2) where S0 is a constant related to scanner gain and proton density, α is the prescribed flip angle, and f is the flip angle correction factor that accounts for inhomogeneity in B1. We have assumed TE << T2*. MTR maps were generated from the gradient echo images performed with and without a magnetization transfer saturation pulse for each voxel using Eq 3: (3) where SIMT_on and SIMT_off are the signal intensities with and without the MT saturation pulse, respectively [27] Fat fraction was calculated from 6-point Dixon data using vendor product software on the MRI scanner. For each multiparametric MRI map (ADC, T1, MTR, fat fraction), the pancreas volume outlined by the radiologist was co-registered and re-gridded to the image resolution of each parametric map to generate a whole-pancreas region of interest. Each MRI parameter was then averaged throughout the whole-pancreas region of interest to yield the mean value of each parameter for voxels within the pancreas. For hepatic fat fraction a circular region of interest of area 4 cm2 was placed on a single slice of the right lobe of the liver while carefully avoiding large vessels and bile ducts. A flowchart summarizing data acquisition and image processing is presented in Fig 2.

thumbnail
Fig 2. Flow chart of MRI data acquisition and processing.

https://doi.org/10.1371/journal.pone.0256029.g002

Statistical analysis

The reproducibility of each radiomic measure was quantified for phantoms across five MRI scanners and for healthy volunteers across four MRI scanners. For phantom studies, the accuracy of volume and T1 measures were calculated as percent difference between the reference and measured value. For measures without reference values, the mean coefficient of variation across MRI scanners was calculated. Friedman’s test was used to assess the difference in each measure across MRI scanners, with post-hoc Wilcoxon rank sum testing to assess differences between each pair of scanners. The difference between scans performed on different individuals on the same scanner (inter-individual variation) was compared with the difference between scans on the same individual using different scanners (inter-assay variation). Power analysis was performed by calculating mean and standard deviation of both inter-individual and inter-assay variation for each MRI measure and calculating the sample size required to achieve a prescribed statistical power. To put our findings in perspective, we also performed power analysis on similar measurements performed on control individuals at a single site (n = 79), an extension of work previously reported [5]. A significance level of p ≤ 0.05 was used for all statistical tests.

Results

To standardize and harmonize imaging across the five centers with different MRI technology and software, synthetic imaging phantoms with known MRI properties were created and shipped to each site for imaging (Fig 1A). Pancreas phantom volume measurements at each of the five sites were similar to the true volume, with a maximum and average difference of 2% from the true value (Table 2). The average difference between T1 measurements at each site and the true values was 6%, with a maximum difference of 13% (Table 2). Of note, one site (Melbourne) had the lowest T1 measurement for each phantom, suggesting there may be bias in T1 mapping on this scanner. The ADC, MTR, and fat fraction measurements were compared across sites, resulting in coefficients of variation of 4.3%, 8.9%, and 0.4%, respectively, across the five sites. We did not detect any temporal changes in these phantoms over the course of these studies. These reproducibility measurements indicate that the acquisition and processing protocol was harmonized across the five sites.

To quantify the reproducibility of quantitative MRI techniques in the pancreas, we sent five volunteers to each of the four MAP-T1D sites in the US (Fig 1B). Multiparametric MRI measurements of the pancreas from these five volunteers are shown in Table 2 and graphically in Fig 3. The average coefficient of variation across five individuals in pancreas volume and PVI were similar at 9.5% and 9.8%, respectively. The ratio of pancreas surface area to volume displayed the lowest coefficient of variation at 5.3%. For the voxel-wise MRI measures, the coefficient of variation was 8.4% for ADC measurements, 9.5% for T1, 39.3% for MTR, 26.5% for pancreatic fat fraction, and 30.2% for hepatic fat fraction. We did not detect a statistically significant difference in any measure across the MRI scanners or between any pair of scanners. For each MRI measure, the difference in measurements between individuals (inter-individual variation) was greater than the difference in measurements made on the same individual on different scanners (inter-assay variation). Dot plots in Fig 3 indicate the distribution of PVI, ADC, and surface area to volume ratio calculated for 79 control subjects at a single site, an extension of our previously published study [5].

thumbnail
Fig 3. Quantitative MRI measures for 5 individuals scanned on four different MRI centers.

Values for each MRI measurement of the pancreas are displayed for: A) pancreas volume index (PVI), B) surface area to volume ratio, C) longitudinal relaxation time (T1), D) apparent diffusion coefficient (ADC), E) pancreatic fat fraction, and F) hepatic fat fraction. Note that fat fraction was not measured in Denver due to a lack of the requisite software. For the graphs of PVI, surface area to volume ratio, and ADC, the distribution of values calculated in healthy volunteers at a single site study (updated from a previously published study [5]) is indicated by dot plot in panels A, B, D.

https://doi.org/10.1371/journal.pone.0256029.g003

Power analysis was performed to estimate the minimum number of subjects required to power clinical trials using MRI measures. Table 3 displays the number of subjects required to detect both differences between two independent samples (e.g., controls versus individuals with diabetes) as well as longitudinal differences in the same individual. Sample sizes are provided to detect 5%, 10%, or 20% changes in each MRI measure at 80% and 90% power. As there was greater inter-individual variation than inter-assay variation for each measure, detecting changes in a single individual, as in a longitudinal study, requires smaller sample sizes. The size measures (volume and PVI) require similar sample sizes to detect changes in an individual, but PVI has added power to detect differences between groups as it accounts for the correlation between body size and pancreas size. The surface area to volume ratio had the highest power for discriminating two groups or detecting changes in an individual. Of the voxel-based measures, ADC and T1 measurements have similar statistical power to pancreas size measures. Pancreatic and hepatic fat fraction have moderate ability to detect changes in an individual, but large inter-individual differences in fat content across individuals limits the ability to detect differences in fat fraction between groups. MTR requires large sample sizes to detect changes in the pancreas. To provide context to these multisite results, we performed derived power measures/indices using a previously acquired dataset of control individuals (n = 79) who underwent longitudinal pancreas MRI on a single MRI scanner [5]. As shown in Table 4, this cohort also displayed greater inter-individual variation than inter-assay variation for each measure and thus was more highly powered to detect changes in an individual than between groups. Sample sizes for detecting changes in an individual were similar for the single site and multisite cohorts, but larger for comparing independent groups in the single site study than the multisite study. The lone exception to this was MTR, which was performed during a breath hold in the single site study which had higher reproducibility.

thumbnail
Table 3. Projected number of study participants required for future clinical trial (multisite).

https://doi.org/10.1371/journal.pone.0256029.t003

thumbnail
Table 4. Projected number of study participants required for future clinical trial (single site).

https://doi.org/10.1371/journal.pone.0256029.t004

To examine the impact of different image acquisition and processing, we performed image processing using both a standardized and non-standardized protocol. To generate the non-standardized image T1 map, B1 field correction was not performed. To simulate non-standardized diffusion processing, we changed the b-values employed to generate ADC maps from 200 and 800 in the standardized protocol to 0 and 800 in the non-standardized protocol. The results of this analysis for subjects imaged at two different sites (Austin and Chicago) are shown in Fig 4. Representative non-standardized T1 and ADC maps are shown in the top row of Fig 4A. In contrast, images acquired and processed using the standardized MAP-T1D protocol at two different sites (Fig 4A, middle and bottom row) display similar values for both T1 and ADC. For each individual, the mean pancreas T1 value calculated using the standardized protocol at two sites was more reproducible than when a non-standardized protocol was employed at one site (Fig 4B). Similarly, the mean pancreatic ADC value calculated using the standardized protocol at two sites displayed better agreement than when a non-standardized protocol was employed (Fig 4C). We calculated the variation induced by using a non-standardized MRI protocol to estimate sample sizes required if MRI protocols are not standardized. A non-standardized MRI protocol with 80% power would require a sample size 22-fold greater to detect a 10% change in ADC and 10-fold greater to detect a 10% change in T1.

thumbnail
Fig 4. Representative difference in quantitative MRI measurements induced by use of different image processing between sites.

A) Representative maps of T1 relaxation time (left column) and ADC (right column) displayed in pseudo color over a T1-weighted image. The top row displays images acquired in Chicago and processed using a non-standardized image processing protocol, demonstrating differences in T1 and ADC values from the standardized protocol (middle row). Images acquired and processed using the standardized MAP-T1D protocol in Chicago on a Philips MRI scanner (middle row) and Austin on a Siemens MRI scanner (bottom row) display concordance for T1 and ADC. All sets of parametric maps are scaled identically for visualization. B) Mean pancreatic T1 values are more reproducible between two sites (Chicago and Austin) using the standardized image analysis protocol (red circles), than when using non-standardized image processing (blue squares). The line of identity indicates perfect agreement. C) Mean pancreatic ADC values are more reproducible between two sites (Chicago and Austin) when using the standardized image analysis protocol (red circles), than when using non-standardized image processing (blue squares).

https://doi.org/10.1371/journal.pone.0256029.g004

Discussion

This study is the first effort to generate a standardized pancreas MRI protocol for techniques that are being used for studying diabetes. When deployed to five different MRI centers, this standardized protocol demonstrated the reproducibility of quantitative imaging measures using both calibrated phantoms and healthy volunteers. Phantom measurements at five different sites demonstrated excellent accuracy to known standards and excellent reproducibility across sites. In pancreas scans in humans, MRI measurements of pancreas volume, ADC, T1, fat fraction, and surface area/volume ratio using a standardized protocol were reproducible across different scanner hardware and software. The harmonized image acquisition and processing tools developed in this study have been made available to anyone interested and can be deployed in multisite clinical trials incorporating pancreas imaging.

Previous MRI studies of the pancreas of individuals with diabetes have led to conflicting results, which likely stem, in part, from disparities in image acquisition and processing. For example, a meta-analysis of pancreatic volume and fat content found high heterogeneity between studies [28]. However, we found that MRI of the pancreas performed at a single site is repeatable [29]. The choice of image acquisition and processing parameters can influence a calculated measure, as previously demonstrated in pancreatic measurements of fat fraction [30], T1 [31] and ADC [32]. Given this dependence on imaging parameters, efforts to standardize MRI protocols for different diseases and anatomies are underway. Neuroimaging studies have been at the forefront of this standardization and have shown that standardized protocols greatly improve the statistical power of multisite studies [33]. Despite evidence promising new insights from pancreas imaging related to diabetes, standardized pancreatic imaging protocols are underdeveloped. While a standardized MRI protocol for imaging of pancreatitis has been proposed [34], it has not been rigorously evaluated using phantoms with known MRI properties or scans on the same individuals across sites. Thus, the current report provides a new approach to integrating pancreas MRI into multisite clinical trials in diabetes and pancreatitis.

We found high accuracy in volume and T1 measurements using phantoms standardized to known values. Of note, an ice water phantom similar to the one used in this study has previously calculated an ADC of 0.0011 mm2/s [23]. However, results from this work, our previous studies [22], and others [35] have found higher ADC values in ice water phantoms, possibly due to phantom heating or positioning of the phantom at the edge of the field of view where gradient nonlinearity is present. Therefore reproducibility, but not accuracy, of ADC was calculated in this study. While a systemic bias internal to the phantom is evident, the high reproducibility of the measured ADC values across five different scanners is reassuring.

For in vivo reproducibility studies, MRI measures displayed marked differences among individuals with no known pancreas pathology. For example, one individual (denoted as Volunteer 5 in Table 2) had increased fat content in both the liver and pancreas. An association between fat accumulation the liver and pancreas has been previously reported [36]. It is known that pancreatic fat content [37] and diffusion measurements are influenced by age and sex [38]. Importantly, the volunteers scanned in this study were similarly aged, and we did not detect a difference in the female subject. The natural inter-individual variability potentially complicates the use of pancreatic imaging in multisite trials, but our power estimates show that using a standardized protocol could decrease the required number of subjects to be enrolled by ten-fold or more. Importantly, the inter-individual differences in MRI measures were preserved across scanners, demonstrating that MRI measures (other than MTR) yield reproducible assays of pancreas size and structure. Measurements of pancreatic MTR were not reproducible in volunteers scanned at multiple sites. This observed variation is likely due to respiratory motion artifacts from this free-breathing acquisition, as phantom MTR values were reproducible and there was higher reproducibility in single-site data where a breath-hold was employed during acquisition [5]. Importantly, this larger cohort of longitudinal scans performed at a single site also displayed higher power for detecting intra-individual changes than comparing across groups. The single site study displayed higher inter-individual variation, likely due to the longitudinal study design and increased heterogeneity in cohort demographics. However, inter-assay variation was similar in the single site and multisite study, suggesting that imaging on multiple scanners did not add variation in any MRI parameter when a standardized protocol was used. In summary, longitudinal monitoring maximizes statistical power and may have important applications in diabetes prediction, staging, and prognosis, as has previously been shown in type 1 diabetes [5].

This study is subject to a number of limitations. MRI scanners from both Philips and Siemens were represented in the study sites, but GE scanners were not part of the current study. Additionally, all scans were performed at 3T. Several quantitative MRI parameters can be influenced by field strength, and thus translation of this protocol to 1.5T field strength will likely require adjustment of imaging parameters. Finally, a larger volunteer cohort would allow for a more precise evaluation of variability. Sending the same individual to each study site for scanning is both expensive and technically difficult, and thus, it is not commonly performed. Given the complexity of navigating volunteer travel and scheduling, we were limited to five individuals scanned at four different sites but showed good agreement in MRI measurements across a wide variety of MRI hardware and software. An additional limitation of this study is the use of a single reader to outline all pancreas images in this study. The use of multiple readers may lead to variation in MRI measurements of the pancreas [29]. Magnetic resonance elastography is another promising technique for assessing the pancreas, but as it requires specialized hardware and software not available at our study sites it was not included in this study. However, a previous study examining the reproducibility of magnetic resonance elastography in healthy controls indicates that it has similar reproducibility to the T1 and ADC measurements in this study [39].

This study demonstrates that, when carefully controlled and standardized, quantitative MRI of the pancreas is highly reproducible across different MRI hardware and software at different geographic locations. Pancreas MRI can now be incorporated into multisite clinical trials of diabetes and other pancreatic diseases. In order to standardize acquisition and processing of MRI studies of the pancreas, we have made our image acquisition protocols and image processing code freely available for any users using Github (https://github.com/jvirostko/MAPT1D). It is our hope that this protocol will be adapted and modified by other groups in the diabetes and imaging community performing MRI of the pancreas. Efforts in employing a common standardized protocol will improve data quality and reporting and facilitate comparison of results across sites and, ultimately, multisite clinical trials. Furthermore, use of a common image acquisition standard will empower future applications of machine learning to studies of pancreas MRI.

Acknowledgments

The University of Chicago would like to thank the Kovler Diabetes Center research team including Mariko Pusinelli, Rabia Ali, and Cristy Miles, for their invaluable help with all aspects of study coordination. We sincerely thank all research participants who took part in this in this study.

References

  1. 1. Tirkes T. Chronic Pancreatitis: What the Clinician Wants to Know from MR Imaging. Magn Reson Imaging Clin N Am. 2018;26(3):451–61. pmid:30376981
  2. 2. Amano Y, Oishi T, Takahashi M, Kumazaki T. Nonenhanced magnetic resonance imaging of mild acute pancreatitis. Abdom Imaging. 2001;26(1):59–63. pmid:11116362
  3. 3. Kuhn JP, Berthold F, Mayerle J, Volzke H, Reeder SB, Rathmann W, et al. Pancreatic Steatosis Demonstrated at MR Imaging in the General Population: Clinical Relevance. Radiology. 2015;276(1):129–36. pmid:25658037
  4. 4. Raman SP, Horton KM, Fishman EK. Multimodality imaging of pancreatic cancer-computed tomography, magnetic resonance imaging, and positron emission tomography. Cancer J. 2012;18(6):511–22. pmid:23187837
  5. 5. Virostko J, Williams J, Hilmes M, Bowman C, Wright JJ, Du L, et al. Pancreas Volume Declines During the First Year After Diagnosis of Type 1 Diabetes and Exhibits Altered Diffusion at Disease Onset. Diabetes care. 2019;42(2):248–57. pmid:30552135
  6. 6. Campbell-Thompson ML, Filipp SL, Grajo JR, Nambam B, Beegle R, Middlebrooks EH, et al. Relative Pancreas Volume Is Reduced in First-Degree Relatives of Patients With Type 1 Diabetes. Diabetes care. 2019;42(2):281–7. pmid:30552130
  7. 7. Gaglia JL, Harisinghani M, Aganj I, Wojtkiewicz GR, Hedgire S, Benoist C, et al. Noninvasive mapping of pancreatic inflammation in recent-onset type-1 diabetes patients. Proceedings of the National Academy of Sciences of the United States of America. 2015;112(7):2139–44. pmid:25650428
  8. 8. Williams AJ, Thrower SL, Sequeiros IM, Ward A, Bickerton AS, Triay JM, et al. Pancreatic volume is reduced in adult patients with recently diagnosed type 1 diabetes. The Journal of clinical endocrinology and metabolism. 2012;97(11):E2109–13. pmid:22879632
  9. 9. Macauley M, Percival K, Thelwall PE, Hollingsworth KG, Taylor R. Altered volume, morphology and composition of the pancreas in type 2 diabetes. PloS one. 2015;10(5):e0126825. pmid:25950180
  10. 10. Burute N, Nisenbaum R, Jenkins DJ, Mirrahimi A, Anthwal S, Colak E, et al. Pancreas volume measurement in patients with Type 2 diabetes using magnetic resonance imaging-based planimetry. Pancreatology: official journal of the International Association of Pancreatology. 2014;14(4):268–74. pmid:25062875
  11. 11. Al-Mrabeh A, Hollingsworth KG, Shaw JAM, McConnachie A, Sattar N, Lean MEJ, et al. 2-year remission of type 2 diabetes and pancreas morphology: a post-hoc analysis of the DiRECT open-label, cluster-randomised trial. Lancet Diabetes Endocrinol. 2020;8(12):939–48. pmid:33031736
  12. 12. Rosenkrantz AB, Mendiratta-Lala M, Bartholmai BJ, Ganeshan D, Abramson RG, Burton KR, et al. Clinical utility of quantitative imaging. Acad Radiol. 2015;22(1):33–49. pmid:25442800
  13. 13. Lee SS, Byun JH, Park BJ, Park SH, Kim N, Park B, et al. Quantitative analysis of diffusion-weighted magnetic resonance imaging of the pancreas: usefulness in characterizing solid pancreatic masses. Journal of magnetic resonance imaging: JMRI. 2008;28(4):928–36. pmid:18821618
  14. 14. Akisik MF, Sandrasegaran K, Jennings SG, Aisen AM, Lin C, Sherman S, et al. Diagnosis of chronic pancreatitis by using apparent diffusion coefficient measurements at 3.0-T MR following secretin stimulation. Radiology. 2009;252(2):418–25. pmid:19508986
  15. 15. Schawkat K, Eshmuminov D, Lenggenhager D, Endhardt K, Vrugt B, Boss A, et al. Preoperative Evaluation of Pancreatic Fibrosis and Lipomatosis: Correlation of Magnetic Resonance Findings With Histology Using Magnetization Transfer Imaging and Multigradient Echo Magnetic Resonance Imaging. Investigative radiology. 2018;53(12):720–7. pmid:30247172
  16. 16. Tirkes T, Lin C, Fogel EL, Sherman SS, Wang Q, Sandrasegaran K. T1 mapping for diagnosis of mild chronic pancreatitis. Journal of magnetic resonance imaging: JMRI. 2017;45(4):1171–6. pmid:27519287
  17. 17. Noda Y, Goshima S, Tsuji Y, Kajita K, Kawada H, Kawai N, et al. Correlation of quantitative pancreatic T1 value and HbA1c value in subjects with normal and impaired glucose tolerance. Journal of magnetic resonance imaging: JMRI. 2019;49(3):711–8. pmid:30430688
  18. 18. Marchesini G, Brizi M, Bianchi G, Tomassetti S, Bugianesi E, Lenzi M, et al. Nonalcoholic fatty liver disease: a feature of the metabolic syndrome. Diabetes. 2001;50(8):1844–50. pmid:11473047
  19. 19. Nadarajah C, Fananapazir G, Cui E, Gichoya J, Thayalan N, Asare-Sawiri M, et al. Association of pancreatic fat content with type II diabetes mellitus. Clin Radiol. 2020;75(1):51–6. pmid:31711639
  20. 20. Al-Mrabeh A, Hollingsworth KG, Shaw JAM, McConnachie A, Sattar N, Lean MEJ, et al. 2-year remission of type 2 diabetes and pancreas morphology: a post-hoc analysis of the DiRECT open-label, cluster-randomised trial. Lancet Diabetes Endocrinol. 2020. pmid:33031736
  21. 21. Schwartz DL, Tagge I, Powers K, Ahn S, Bakshi R, Calabresi PA, et al. Multisite reliability and repeatability of an advanced brain MRI protocol. J Magn Reson Imaging. 2019;50(3):878–88. pmid:30652391
  22. 22. Sorace AG, Wu C, Barnes SL, Jarrett AM, Avery S, Patt D, et al. Repeatability, reproducibility, and accuracy of quantitative mri of the breast in the community radiology setting. Journal of magnetic resonance imaging: JMRI. 2018.
  23. 23. Chenevert TL, Galban CJ, Ivancevic MK, Rohrer SE, Londy FJ, Kwee TC, et al. Diffusion coefficient measurement using a temperature-controlled fluid for quality control in multicenter studies. Journal of magnetic resonance imaging: JMRI. 2011;34(4):983–7. pmid:21928310
  24. 24. Koenig SH, Brown RD 3rd, Ugolini R. Magnetization transfer in cross-linked bovine serum albumin solutions at 200 MHz: a model for tissue. Magn Reson Med. 1993;29(3):311–6. pmid:8383788
  25. 25. Szczepaniak EW, Malliaras K, Nelson MD, Szczepaniak LS. Measurement of pancreatic volume by abdominal MRI: a validation study. PloS one. 2013;8(2):e55991. pmid:23418491
  26. 26. Whisenant JG, Dortch RD, Grissom W, Kang H, Arlinghaus LR, Yankeelov TE. Bloch-Siegert B1-Mapping Improves Accuracy and Precision of Longitudinal Relaxation Measurements in the Breast at 3 T. Tomography. 2016;2(4):250–9. pmid:28044146
  27. 27. Henkelman RM, Stanisz GJ, Graham SJ. Magnetization transfer in MRI: a review. NMR in biomedicine. 2001;14(2):57–64. pmid:11320533
  28. 28. Garcia TS, Rech TH, Leitao CB. Pancreatic size and fat content in diabetes: A systematic review and meta-analysis of imaging studies. PloS one. 2017;12(7):e0180911. pmid:28742102
  29. 29. Williams JM, Hilmes MA, Archer B, Dulaney A, Du L, Kang H, et al. Repeatability and Reproducibility of Pancreas Volume Measurements Using MRI. Sci Rep. 2020;10(1):4767. pmid:32179809
  30. 30. Hu HH, Kim HW, Nayak KS, Goran MI. Comparison of fat-water MRI and single-voxel MRS in the assessment of hepatic and pancreatic fat fractions in humans. Obesity (Silver Spring). 2010;18(4):841–7.
  31. 31. Tirkes T, Zhao X, Lin C, Stuckey AJ, Li L, Giri S, et al. Evaluation of variable flip angle, MOLLI, SASHA, and IR-SNAPSHOT pulse sequences for T1 relaxometry and extracellular volume imaging of the pancreas and liver. MAGMA. 2019;32(5):559–66. pmid:31165353
  32. 32. Dale BM, Braithwaite AC, Boll DT, Merkle EM. Field strength and diffusion encoding technique affect the apparent diffusion coefficient measurements in diffusion-weighted imaging of the abdomen. Investigative radiology. 2010;45(2):104–8. pmid:20027117
  33. 33. George A, Kuzniecky R, Rusinek H, Pardoe HR, Human Epilepsy Project I. Standardized Brain MRI Acquisition Protocols Improve Statistical Power in Multicenter Quantitative Morphometry Studies. J Neuroimaging. 2020;30(1):126–33. pmid:31664774
  34. 34. Tirkes T, Yadav D, Conwell DL, Territo PR, Zhao X, Venkatesh SK, et al. Magnetic resonance imaging as a non-invasive method for the assessment of pancreatic fibrosis (MINIMAP): a comprehensive study design from the consortium for the study of chronic pancreatitis, diabetes, and pancreatic cancer. Abdom Radiol (NY). 2019;44(8):2809–21. pmid:31089778
  35. 35. Moreau B, Iannessi A, Hoog C, Beaumont H. How reliable are ADC measurements? A phantom and clinical study of cervical lymph nodes. Eur Radiol. 2018;28(8):3362–71. pmid:29476218
  36. 36. Patel NS, Peterson MR, Brenner DA, Heba E, Sirlin C, Loomba R. Association between novel MRI-estimated pancreatic fat and liver histology-determined steatosis and fibrosis in non-alcoholic fatty liver disease. Aliment Pharmacol Ther. 2013;37(6):630–9. pmid:23383649
  37. 37. Heber SD, Hetterich H, Lorbeer R, Bayerl C, Machann J, Auweter S, et al. Pancreatic fat content by magnetic resonance imaging in subjects with prediabetes, diabetes, and controls from a general population without cardiovascular disease. PLoS One. 2017;12(5):e0177154. pmid:28520813
  38. 38. Herrmann J, Schoennagel BP, Roesch M, Busch JD, Derlin T, Doh LK, et al. Diffusion-weighted imaging of the healthy pancreas: ADC values are age and gender dependent. J Magn Reson Imaging. 2013;37(4):886–91. pmid:23086728
  39. 39. Shi Y, Glaser KJ, Venkatesh SK, Ben-Abraham EI, Ehman RL. Feasibility of using 3D MR elastography to determine pancreatic stiffness in healthy volunteers. Journal of magnetic resonance imaging: JMRI. 2015;41(2):369–75. pmid:24497052