https://orcid.org/0000-0001-9138-9450
Figures
Abstract
When dealing with longitudinal data, linear mixed-effects models (LMMs) are often used by researchers. However, LMMs are not always the most adequate models, especially if we expect a nonlinear relationship between the outcome and a continuous covariate. To allow for more flexibility, we propose the use of a semiparametric mixed-effects model to evaluate the overall treatment effect on the hemodynamic responses during bone graft healing and build a prediction model for the healing process. The model relies on a closed-form expectation–maximization algorithm, where the unknown nonlinear function is estimated using a Lasso-type procedure. Using this model, we were able to estimate the effect of time for individual mice in each group in a nonparametric fashion and the effect of the treatment while accounting for correlation between observations due to the repeated measurements. The treatment effect was found to be statistically significant, with the autograft group having higher total hemoglobin concentration than the allograft group.
Citation: Leon S, Ren J, Choe R, Wu TT (2022) Semiparametric mixed-effects model for analysis of non-invasive longitudinal hemodynamic responses during bone graft healing. PLoS ONE 17(4): e0265471. https://doi.org/10.1371/journal.pone.0265471
Editor: Eugene Demidenko, Dartmouth College Geisel School of Medicine, UNITED STATES
Received: September 2, 2021; Accepted: March 2, 2022; Published: April 5, 2022
Copyright: © 2022 Leon et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting information files.
Funding: RC and TTW’s work was partly supported by grant from the National Institutes of Health NIH R01AR071363; TTW’s work was also supported by grant from the National Science Foundation NSF CCF-1934962. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Critical-sized bone defects are those that cannot heal without intervention. Each year, more than 2.2 million bone grafting procedures are performed worldwide for treating critical-sized bone defects [1, 2]. The gold standard treatment is to implant allograft harvested from cadavers to the defect site. However, such allograft is devitalized to prevent immune response therefore leading to a high long-term failure rate [3, 4]. Animal models including mice are widely used for developing and evaluating new treatments to enhance allograft healing. For example, a hydrogel-based tissue-engineered periosteum delivering stem cells to the allograft was found to enhance allograft healing in a mouse model [5, 6]. Vascularization, the development of blood vessels, is widely measured for evaluating the bone healing in these studies [7–9], since vascularization is regarded as a precursor of bone formation [8, 10, 11]. In animal studies, vasculatures in the bone are measured using contrast agent-mediated micro-computed tomography (micro-CT) [5, 6, 12]. This procedure is terminal thus making the longitudinal vascularization monitoring of an individual mouse impossible. Therefore, a non-terminal in vivo technique is needed for frequent longitudinal monitoring of the bone vascularization.
Previously, we applied spatial frequency domain imaging (SFDI) for measuring the amount and the quality of vascularization, in particular, total hemoglobin concentration (THC) and blood oxygen saturation (StO2) in a mouse femoral model [13]. SFDI is a non-invasive imaging technique where near-infrared (NIR) light is employed to quantify THC and StO2 [14, 15]. In that study, mice with two types of femoral grafts, autograft and allograft, were measured longitudinally from one day before injury to day 44 post-injury. Different from allograft, autograft is harvested from the same injured mouse without devitalization. Therefore, autograft is regarded to have a better vascularization and healing potential [5, 6, 16–18]. However, the detailed temporal trend of the vascularization was not readily available, partially due to the lack of noninvasive monitoring tools. To find out the optimal time points for monitoring, we first performed daily SFDI measurement in the first two weeks. The measurement frequency decreased to twice a week after week 2 based on the observation that mice started to develop resistance to anesthesia. When analyzing the data, we excluded the data in the first week due to signal contamination caused by the sutures covering the wound site. All these adaptations in measurement frequency and data analysis resulted in uneven time points in the longitudinal data.
To account for the repeated measurements from the same mouse in the longitudinal monitoring, the data were analyzed using a linear mixed-effects model (LMM). LMMs are used to describe the relationship between the response (e.g., THC or StO2) and a set of predictors (e.g., time) that are clustered according to one or more classification factors, and hence are ideal to analyze repeated measures data. They assume a linear relationship between the response and the predictors, which, however, might over-simplify the relationship. In our study, the physiological changes of THC or StO2 during the bone healing are usually nonlinear. Therefore, in the previous analysis [13], the time indicator was treated as a categorical variable to give more flexibility. By fitting a LMM, a significant treatment effect was detected for THC between the two graft types [13]. However, this approach has several limitations. First, the linearity assumption is too stringent and not desirable in many situations as people might expect a nonlinear relationship between the response and predictors. Second, by treating the time indicator as a categorical variable, the LMM allows an arbitrary pattern of temporal changes. However, it is unable to make predictions at a time point different than those categorical time points (e.g., one cannot make prediction at day 2 or 3, which is not part of the time points when data were collected). Moreover, a LMM is not suitable for datasets with a large number of time points when the number of subjects is small [19], e.g., time series data. Given these reasons, we need a mixed-effects model that can estimate both treatment effect and the nonlinear pattern of temporal effects.
In this study, we propose the use of a semiparametric mixed-effects model (SMM) [20, 21], which is the the state of art in longitudinal data modeling, for the analysis of the longitudinal vascularization data during mouse femoral graft healing described in [13]. Our aim is to evaluate the overall treatment effect and build a prediction model for the healing process. By fitting a SMM, we are able to (1) test if there exists a significant overall treatment effect; (2) estimate the effect size of treatment; (3) model the relationship between the total hemoglobin concentration and treatment over time; (4) model the nonlinear pattern of the temporal effects; (5) make prediction at any arbitrary time point during the healing process. An additional advantage of SMM is that varying time points are allowed, e.g., due to adaptation made to accommodate the development of anesthesia resistance, etc. Last but not least, a SMM could also enable researchers to identify the earliest time point that begins to show a group difference. As discussed later in the Results section, we could choose Day 7 for rTHC and be confident the overall treatment effects would be sustained throughout the following time period.
In SMM, the longitudinal response can be considered as a function of time, where time is treated as a continuous variable. The model fitting is more data-driven and has no restriction on the shape of the fitted model. By doing that, a nonlinear relationship is allowed between the longitudinal response and predictors. The second advantage is that prediction can be made at any time since time is continuous. Third, the model works well in the situation where there are a large number of time points with only a few observations or even only one observation at a time.
The rest of the paper is organized as follows. We will describe the data and the SMM in the next section. The results using SMM will be then presented. The paper will be concluded with a discussion at the end.
Materials and methods
Data description
SFDI data from our previous study [13] are presented in Fig 1. The hemodynamic observations (THC and StO2) of each group from the longitudinal SFDI measurements are shown. Graft THC and StO2 were extracted from two-dimensional SFDI images of the mouse hindlimb at each day, by taking the mean within a rectangular region of interest (ROI). The ROI was defined over the mid-diaphysis, which is the location of the implanted graft. The hemodynamic observations of the allografts and autografts are shown on the left and right column of Fig 1, respectively. Qualitatively speaking, the autograft group exhibits higher THC than the allograft group in the later stage of the healing (e.g., approximately after 3 weeks). The StO2 of both groups fluctuates around the value of 40% during the healing process.
(a) THC of the allograft group; (b) THC of the autograft group; (c) StO2 of the allograft group; (d) StO2 of the autograft group. The error bar indicates the standard deviation of the quantity (THC or StO2) within the region of interest.
Semiparametric mixed-effects model
To account for the repeated measurements of each mouse, a SMM was used to model the longitudinal response variables with random intercepts. We used the total hemoglobin concentration (THC) as the example in this section, and similar models could be fitted for other response variables. The SMM is defined as follows:
where t is the time (in days), g is the graft type (0 for allograft and 1 for autograft), ϕ is the random intercept for individual subjects, and ϵ is the random noise. The intercept β0 indicates the overall mean of THC, β1 is the regression coefficients of g, and fg(t) belongs to the space of polynomials and represents the nonparametric part of the model which captures the effect of time for each mouse in each group. The function fg is unknown and needs to be estimated.
As a comparison, the LMM is given by:
where the time related part β2t + β3t ⋅ g = (β2 + β3g) ⋅ t is the counterpart of fg(t) in SMM. It is easy to see that LMM assumes a linear time trend, i.e., (β2 + β3g) ⋅ t, while fg(t) is the nonlinear function of time in SMM. In other words, the SMM models the joint effects of time and group through fg(t), the LMM captures the effects using two linear terms β2t + β3t ⋅ g. The latter has some limitations that we can circumvent using a SMM, as discussed in the introduction.
Estimation of SMM
The parameters of the SMM are estimated using a penalized expectation-maximization (EM) algorithm proposed by [22], where at each iteration of the EM algorithm the parameters are estimated jointly. A penalty term is used to estimate a Lasso (least absolute shrinkage and selection operator)-type estimator [23] of fg, the estimate of ϕ is obtained in the M-step of the algorithm, and the coefficients β0 and β1 are estimated using least-squares based on the estimates of fg = Fλ and ϕ.
Let N be the number of mice with ni observations each, and . A set {ψ1, …, ψM} of potential basis functions is provided to the algorithm, and the Lasso procedure will automatically select the basis functions. At iteration h + 1, λ can be updated as
where
is a block matrix, F0 = (ψk(tij))k,i,j with tij only corresponding to times of mouse receiving allograft, similarly F1 = (ψk(tij))k,i,j with tij only corresponding to times of mouse receiving autograft,
is a penalty term, γ > 0 is the tuning parameter and
.
The function fg is finally estimated as
The tuning parameter γ controls the smoothness of fg, where a larger value of γ will induce more λ coefficients to be set to zero, which will result in a smoother curve. In our analysis, the set of basis functions is given by cubic splines, Fourier bases, power functions and Haar functions.
The two parameters ϕ(h+1) and σ2,(h+1) are estimated following the two steps of the EM algorithm:
- E-step:
where Z = diag(Z1, …, ZN) with Zi a vector of ni ones,
and W is the conditional variance of ϕ.
- M-step:
where
.
The fixed effects β = (β0, β1)′ are estimated using least-squares applied on THC − Fλ(h+1) − ϕ(h+1), by solving X′Xβ(h+1) = X′(THC − Fλ(h+1) − ϕ(h+1)), with X the design matrix with first column a vector of ones, and second column g.
We refer to [22] for details on how to derive the formulas. Some considerations for the tuning parameter γ are given in [24], and the authors proved that for γ > 2 the estimator of fg satisfies an oracle inequality. However, since γ also influences the stability of the EM algorithm, their recommendation is then to choose a γ value that is close to 2, which makes the EM algorithm more stable.
Results
Choice of γ
Effects of γ on the significance of β.
The model estimation depends on the value of the tuning parameter γ. We therefore examined the effects of γ by plotting the coefficient β1 of the group effect g vs. γ on a grid between 0 and 2, with increments of 0.05, shown in Fig 2 for THC and in Fig 3 for rTHC. In both figures, the choice of γ has an impact on the value and significance of . For THC (Fig 2), when γ = 0 or 0.05, the estimated group effect coefficient is insignificant (p-value > 0.05); while γ ≥ 0.1 makes the estimated group coefficient significant. For rTHC (Fig 3), the γ value does not affect the statistical significance of the group coefficient—as long as γ > 0,
is always significant with p < 0.05. In both cases, the estimated regression coefficient is zero when γ = 0. However, γ = 0 is not a reasonable choice since the estimate of fg(t) will be the group mean at each time point, and there is then no information left to be explained by the group coefficient.
The group coefficient β1 is estimated at different γ values. Any coefficients above the red line are statistically significant with p < 0.05, the red line crosses the curve at the point .
The group coefficient β1 is estimated at different γ values. Any coefficients above the red line are statistically significant, the red line crosses the curve at the point .
We observed similar patterns for the response variable StO2. The choice of γ has an impact on the value of regression coefficients, but does not affect much on the statistical significance. We therefore omit the plots for StO2 and rStO2.
Effects of γ on the smoothness of fg(t).
In Fig 4 we plotted the estimated THC trajectories for both treatment groups using a SMM with different values of γ. There is a clear trade-off between fitting the data adequately and getting a smooth curve. We can see that γ = 0 and γ = 2 do not appear to be good candidates, since one follows every small variation of the data and the other one is almost a straight line. We then chose a value of γ that was able to capture the variations of the data while remaining smooth, our choice is γ = 0.5. For the rest of the analysis the results will be based on this value.
Black curves are observed THC trajectories. a) SMM estimates using γ = 0, b) SMM estimates using γ = 0.5, c) SMM estimates using γ = 2.
Results for THC
THC.
The allograft group and autograft group appear to have different trends. They both show an initial increase, but after this initial increase only the autograft group keeps on increasing, while the allograft group seems to roughly fluctuate around the same value of 145 μM. A formal test for a difference between the two groups can be performed during the least-squares step of the algorithm. The results are presented in Table 1, the intercept corresponds to the estimated THC mean of the allograft group after subtracting the effect of time in each group, and the effect associated to the repeated measurements of each mouse. The group effect is statistically significant when using γ = 0.5, however some choices of γ can make the coefficient not statistically significant with a p-value close to 0.05 but slightly larger. It is then not clear if there is truly a difference between the two groups for THC. It can be seen from Fig 5(a) as well that the difference between the two estimated trajectories of the two treatments is not obvious until toward the end of the study.
(a) Estimated THC trajectories over time by SMM (thick curves) for the allograft group (red) and the autograft group (blue) at γ = 0.5. The dashed curves are the observed THC trajectories of individual mice in each group. (b) Estimated rTHC trajectories over time by SMM (thick curves) for the allograft group (red) and the autograft group (blue) at γ = 0.5. The dashed curves are the observed rTHC trajectories of individual mice in each group.
rTHC.
From Fig 4, we can see that the pre-surgery THC value of the autograft group is lower than the allograft group. To account for the variation among individuals the same analysis is performed using a relative THC (rTHC), for each mouse the THC values are normalized by their pre-surgery THC values. The estimated rTHC trajectories for both groups using γ = 0.5 are shown in Fig 5. From Fig 5, we see that the difference between the two groups is even more noticeable than when using THC and the difference begins as early as Day 7. As a result, the group effect is greater and highly significant. In Table 1, the estimated mean of the allograft group is 143.40 μM and 147.50 μM for the autograft group, which corresponds to a 2.86% increase. The effect from Table 1 suggests that the estimated relative mean of the autograft group is now 12.9% greater than the estimated relative mean of the allograft group.
Results for StO2
The same method is applied to the variable StO2, which is the blood oxygen saturation of the graft and the surrounding soft tissues. In Fig 6, the groups appear to be similar in their trends, the main difference is at 30 days where the allograft group shows a larger decrease than the autograft group. Table 2 suggests that the difference is not statistically significant. The same analysis is performed on the relative StO2 (rStO2), using γ = 0.5. We see similar trends for both groups in Fig 6, and in Table 2 the difference is still not statistically significant.
(a) Estimated StO2 trajectories over time by SMM (thick curves) for the allograft group (red) and the autograft group (blue) at γ = 0.5. The dashed curves are the observed StO2 trajectories of individual mice in each group. (b) Estimated rStO2 trajectories over time by SMM (thick curves) for the allograft group (red) and the autograft group (blue) at γ = 0.5. The dashed curves are the observed rStO2 trajectories of individual mice in each group.
Discussion
In this study, we applied SMM for analyzing the hemodynamic data from a longitudinal mouse bone healing monitoring. Significant difference of the longitudinal THC was found between the autograft and allograft groups. However, no significant difference of StO2 was found between two groups. The result is consistent with that from the previous LMM method and agrees with the physiological expectation. Even though both the LMM and SMM indicated a significant treatment effect for this particular dataset, SMM is more versatile and advantageous than LMM. Instead of treating the time as a categorical variable, the SMM allows nonlinear relationships between the hemodynamic observation and the time. The continuous time in the model also allows prediction of the hemodynamic changes within the period of monitoring. In pre-clinical and clinical research, missing time points are common due to physiological, technical, or scheduling limitations. The SMM could help estimating the hemodynamic parameters at the missing time points.
One of the caveats of SMM is the complexity of the method, leading to difficulty in implementation. This may potentially impact the wide-spread usage of this particular method. However, the ability to handle non-linearity of the dataset in longitudinal analysis could greatly relax the stringent linearity assumption by the LMM method.
Another limitation of SMM is the determination of the tuning parameter γ. In the paper of [22], the authors recommended some value larger than 2 but as close as 2. In our limited numerical experiments, we found such a value is not a good choice and leads to an overly smoothing result (see Fig 4). Our experience is to tune γ over a grid between 0 and 2 and select a value that gives a balance of model fitting adequacy and smoothness. Of course, it is of great interest to develop a criterion that can be used to determine the optimal value automatically and objectively, which will be studied in the near future.
The third limitation of SMM is that it cannot account for the heteroscedasticity. It is shown in Fig 1(b) and 1(c) that the variation gets larger over time (the variation is fairly stable in (a) and (d)), while SMM assumes a constant variance, which is a limitation. We are not aware of any model that can take into account the heteroscedasticity while fulfilling all of our goals. Extending the current model by incorporating heteroscedasticity is out of the scope of this paper but will be considered in future research.
Last but not least, SMM is prone to overfitting due to the model complexity. The discovered nonlinear pattern could be the pattern of noises and might not be applicable outside the sample. Our findings would be tested using new observations in future studies.
In summary, the advantages of the SMM model makes it suitable for a broader range of biomedical applications. The SMM can be used in various longitudinal studies with different monitoring techniques and/or biological systems. For example, analysis of the longitudinal blood flow measured by diffuse correlation technique could evaluate the healing in bone injury [16–18] or the efficacy of chemotherapeutic drugs in breast cancer [25]. The monitoring techniques could be any spectroscopy or imaging techniques as long as they can provide longitudinal data.
Acknowledgments
The authors thank the Editor for handling the paper and providing constructive comments and suggestions.
References
- 1. Greenwald AS, Boden SD, Goldberg VM, Khan Y, Laurencin CT, Rosier RN. Bone-graft substitutes: facts, fictions, and applications. J Bone Joint Surg Am. 2001;83-A(Suppl 2 Pt 2):98–103. pmid:11712842
- 2. Giannoudis PV, Dinopoulos H, Tsiridis E. Bone substitutes: an update. Injury. 2005;36 Suppl 3:S20–7. pmid:16188545
- 3. Mankin HJ, Hornicek FJ, Raskin KA. Infection in massive bone allografts. Clin Orthop Relat Res. 2005;432:210–6. pmid:15738824
- 4. Wheeler DL, Enneking WF. Allograft bone decreases in strength in vivo over time. Clin Orthop Relat Res. 2005;435:36–42. pmid:15930919
- 5. Hoffman MD, Xie C, Zhang X, Benoit DSW. The effect of mesenchymal stem cells delivered via hydrogel- based tissue engineered periosteum on bone allograft healing. Biomaterials. 2013;34(35):8887–98. pmid:23958029
- 6. Hoffman MD, Benoit DS. Emulating native periosteum cell population and subsequent paracrine factor production to promote tissue engineered periosteum-mediated allograft healing. Biomaterials. 2015;52:426–40. pmid:25818449
- 7. Gerstenfeld LC, Cullinane DM, Barnes GL, Graves DT, Einhorn TA. Fracture healing as a post-natal developmental process: Molecular, spatial, and temporal aspects of its regulation. J Cell Biochem. 2003;88(5):873–84. pmid:12616527
- 8. Einhorn TA, Gerstenfeld LC. Fracture healing: mechanisms and interventions. Nat Rev Rheumatol. 2015;11(1):45–54. pmid:25266456
- 9. Buza JA, Einhorn T. Bone healing in 2016. Clin Cases Miner Bone Meta. 2016;13(2):101–5. pmid:27920804
- 10. Tomlinson RE, Silva MJ. Skeletal Blood Flow in Bone Repair and Maintenance. Bone Res. 2013;1(4):311–22. pmid:26273509
- 11. Roberts TT, Rosenbaum AJ. Bone grafts, bone substitutes and orthobiologics: The bridge between basic science and clinical advancements in fracture healing. Organogenesis. 2012;8(4):114–24. pmid:23247591
- 12. Wang Y, Newman MR, Ackun-Farmmer M, Baranello MP, Sheu TJ, Puzas JE, et al. Fracture-Targeted Delivery of beta-Catenin Agonists via Peptide-Functionalized Nanoparticles Augments Fracture Healing. ACS Nano. 2017;11(9):9445–58. pmid:28881139
- 13. Ren J, Ramirez GA, Proctor AR, Wu TT, Benoit DSW, Choe R. Spatial frequency domain imaging for the longitudinal monitoring of vascularization during mouse femoral graft healing. Biomed Opt Express. 2020;11(10):5442–55. pmid:33149961
- 14. Cuccia DJ, Bevilacqua F, Durkin AJ, Tromberg BJ. Modulated imaging: quantitative analysis and tomography of turbid media in the spatial-frequency domain. Opt Lett. 2005;30(11):1354–6. pmid:15981531
- 15. Cuccia DJ, Bevilacqua F, Durkin AJ, Ayers FR, Tromberg BJ. Quantitation and mapping of tissue optical properties using modulated imaging. J Biomed Opt. 2009;14(2):024012. pmid:19405742
- 16. Han S, Proctor AR, Vella JB, Benoit DS, Choe R. Non-invasive diffuse correlation tomography reveals spatial and temporal blood flow differences in murine bone grafting approaches. Biomed Opt Express. 2016;7(9):3262–79. pmid:27699097
- 17. Han S, Proctor AR, Ren J, Benoit DSW, Choe R. Temporal blood flow changes measured by diffuse correlation tomography predict murine femoral graft healing. PLoS One. 2018;13(5):e0197031. pmid:29813078
- 18. Ren J, Han S, Proctor AR, Desa DE, Ramirez GA, Ching-Roa VRD, et al. Longitudinal 3D Blood Flow Distribution Provided by Diffuse Correlation Tomography during Bone Healing in a Murine Fracture Model. Photochem Photobiol. 2020;96(2):380–7. pmid:31883385
- 19.
Snijders TA, Bosker RJ. Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling, second edition. SAGE Publishers; 2012.
- 20. Taavoni M, Arashi M. High-dimensional generalized semiparametric model for longitudinal data. Statistics;55:831–50.
- 21. Taavoni M, Arashi M, Wang WL, Lin TI. Multivariate t semiparametric mixed-effects model for longitudinal data with multiple characteristics. Journal of Statistical Computation and Simulation;92:260–81.
- 22. Arribas-Gil A, De la Cruz R, Lebarbier E, Meza C. Classification of longitudinal data through a semiparametric mixed-effects model based on lasso-type estimators. Biometrics. 2015;71(2):333–43. pmid:25639332
- 23. Tibshirani R. Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society (Series B). 1996;58:267–88.
- 24. Arribas-Gil A, Bertin K, Meza C, Rivoirard V. Lasso-type estimators for semiparametric nonlinear mixed-effects models estimation. Statistics and Computing. 2014;24(3):443–60.
- 25. Ramirez G, Proctor AR, Jung KW, Wu TT, Han S, Adams RR, et al. Chemotherapeutic drug-specific alteration of microvascular blood flow in murine breast cancer as measured by diffuse correlation spectroscopy. Biomedical optics express. 2016;7(9):3610–30. pmid:27699124