Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Malignant Potential of Gastrointestinal Cancers Assessed by Structural Equation Modeling

  • Haruo Shimizu ,

    Contributed equally to this work with: Haruo Shimizu, Yoshiaki Arimura

    Affiliation Department of Gastroenterology, Rheumatology, and Clinical Immunology, Sapporo Medical University, Sapporo, Japan

  • Yoshiaki Arimura ,

    Contributed equally to this work with: Haruo Shimizu, Yoshiaki Arimura

    arimura@sapmed.ac.jp

    Affiliation Department of Gastroenterology, Rheumatology, and Clinical Immunology, Sapporo Medical University, Sapporo, Japan

  • Kei Onodera,

    Affiliation Department of Gastroenterology, Rheumatology, and Clinical Immunology, Sapporo Medical University, Sapporo, Japan

  • Hiroaki Takahashi,

    Affiliation Department of Gastroenterology, Keiyukai Daini Hospital, Sapporo, Japan

  • Satoshi Okahara,

    Affiliation Department of Gastroenterology, Keiyukai Daini Hospital, Sapporo, Japan

  • Junichi Kodaira,

    Affiliation Department of Gastroenterology, Keiyukai Daini Hospital, Sapporo, Japan

  • Hirokazu Oohashi,

    Affiliation Department of Gastroenterology, Keiyukai Daini Hospital, Sapporo, Japan

  • Hiroyuki Isshiki,

    Affiliation Department of Gastroenterology, Rheumatology, and Clinical Immunology, Sapporo Medical University, Sapporo, Japan

  • Kentaro Kawakami,

    Affiliation Department of Gastroenterology, Rheumatology, and Clinical Immunology, Sapporo Medical University, Sapporo, Japan

  • Kentaro Yamashita,

    Affiliation Department of Gastroenterology, Rheumatology, and Clinical Immunology, Sapporo Medical University, Sapporo, Japan

  • Yasuhisa Shinomura,

    Current address: Department of Gastroenterology, Ikeda Municipal Hospital, Osaka, Japan

    Affiliation Department of Gastroenterology, Rheumatology, and Clinical Immunology, Sapporo Medical University, Sapporo, Japan

  • Masao Hosokawa

    Affiliation Department of Surgery, Keiyukai Hospital, Sapporo, Japan

Abstract

Background

Parameters reported in pathologic reviews have been failing to assess exactly the malignant potential of gastrointestinal cancers. We hypothesized that malignant potential could be defined by common latent variables (hypothesis I), but there are substantial differences in the associations between malignant potential and pathologic parameters according to the origin of gastrointestinal cancers (hypothesis II). We shed light on these issues by structural equation modeling.

Materials and Methods

We conducted a cross-sectional survey of 217 esophageal, 192 gastric, and 175 colorectal cancer patients who consecutively underwent curative surgery for their pathologic stage I cancers at Keiyukai Sapporo Hospital. Latent variables identified by factor analysis and seven conventional pathologic parameters were introduced in the structural equation modeling analysis.

Results

Because latent variables were disparate except for their number, 'three' in the examined gastrointestinal cancers, the first hypothesis was rejected. Because configural invariance across gastrointestinal cancers was not approved, the second hypothesis was verified. We could trace the three significant paths on the causal graph from latent variables to lymph node metastasis, which were mediated through depth, lymphatic invasion, and matrilysin expression in esophageal cancer, whereas only one significant path could be traced in both gastric and colorectal cancer. Two of the three latent variables were exogenous in esophageal cancer, whereas one factor was exogenous in the other gastrointestinal cancers. Cancer stemness promoted viability in esophageal cancer, but it was suppressed in others.

Conclusion

These results reflect the malignant potential of esophageal cancer is higher than that of the other gastrointestinal cancers. Such information might contribute to refining clinical treatments for gastrointestinal cancers.

Introduction

The popular terms ‘malignant potential’ or ‘biological malignancy’ of gastrointestinal (GI) cancers including esophageal (ECA), gastric (GCA), and colorectal cancer (CRC) are versatile to use in practice but equivocal to define in theory. Nevertheless, pathologic parameters, such as tumor depth of penetration, cancer grade, lymphovascular invasion, and lymph node metastasis, are commonly used to assess the malignant potential, such as curability by endoscopic resection in GI cancers [14]. However, each parameter is expected to have various clinical significances reflecting the malignant potential, such as the risk of metastatic spread. Therefore, we are unable to adequately translate and use the information from preexisting pathological reviews of GI cancer. In contrast to conventional pathological reviews [58], we previously suggested tumor matrilysin expression can predict the metastatic potential of pathologic stage I (pT1) colon and rectal cancers [9]. Fortunately, locoregional nodes are almost invariably the initial site of metastatic spread in pT1 GI cancers. Therefore, the development of lymph node metastasis should reflect the metastatic and partly malignant potential of the primary tumor of pT1 GI cancers. In this study, to assess the poorly defined metastatic potential, we introduce structural equation modeling (SEM) focusing on pT1 GI cancers in patients who have undergone surgery.

In general, SEM encompasses two components: measurement and structural models [10]. The measurement model specifies the relationship of the latent and observed variables, whereas the structural model identifies specific relationships among the latent variables. SEM allows testing of hypothesized direct, indirect or mediated, and total associations of latent variables to each other and between observed and unobserved latent variables. Therefore, SEM can analyze relationships among the theoretical variables of primary interest without the effects being confounded by measurement errors [11]. Furthermore, SEM allows simultaneous analysis of the effect of multiple independent variables on several dependent variables, whereas multiple regression analysis testing allows evaluation of only one dependent variable at a time. In this context, the usual terms of dependent and independent variables are less appropriate because the dependent variable in one equation might be an independent variable in another equation. For this reason, the variables in a model are called either endogenous or exogenous [11].

The premise of SEM is to determine whether a theoretical model is supported by the collected data. Thus, we propose two hypotheses in this study. Hypothesis I is that the malignant potential of pT1 GI cancers can be determined by common latent variables. Hypothesis II is that there are substantial differences in the associations between the malignant potential and pathological parameters according to the cancer origin. Our primary objective was to verify these hypotheses by SEM.

Materials and Methods

Study participants

We conducted a cross sectional survey involving three groups of patients with pT1 GI cancer, defined as invasion of the tumor into the submucosa, who underwent curative surgery at Keiyukai Sapporo Hospital: 217 consecutive patients with ECA (male/female = 203/14, age: 41–82 years), 192 patients with GCA (male/female = 136/56, age: 33–91 years), and 175 patients CRC (male/female = 123/52, age: 31–81). All patients were enrolled during the 10-year recruitment period from Mar 2004 to Apr 2014 (Table 1). All esophageal tumors were squamous cell carcinoma, whereas others were adenocarcinomas. Clinicopathological features were classified according to the TNM (tumor, nodes, metastasis) classification of the Union for International Cancer Control [12]. We excluded patients with multiple primary cancers, familial cancer syndromes, and idiopathic inflammatory bowel disease. All participants provided written informed consent based on the Declaration of Helsinki (1964, 1975, amended in 1983, 2003 and 2008) of the World Medical Association. The study was approved by the institutional review board of Keiyukai Sapporo Hospital and the Ethics Committee of Sapporo Medical University. Clinicopathological data were retrieved from the medical and pathological records (Table 1).

Demographic data and measures

The clinicopathological features of the patients were analyzed according to pathologic parameters, such as tumor depth of penetration, cancer histological grade (well, moderately, and poorly differentiated carcinoma are abbreviated as well, mod, and por, respectively), lymphatic/vascular invasion (ly/v), lymph node metastasis (n), tumor size, age, gender, and matrilysin expression. Measurements of pathologic parameters were based on the Japanese classification of esophageal/gastric/colorectal cancer as follows [1315]. Depth of penetration was scored as submucosal invasion 1 (sm1), sm2, or sm3, in which sm2 was defined between sm1 (slight invasion was defined when the tumor invaded the upper third of the submucosal layer) and sm3 (massive invasion was defined when the tumor invaded the lower third layer) [13]. In this study, the subclassification of sm1 to 3 was commonly adopted in both gastric and colorectal cancers as well as esophageal cancers because of analyzing simultaneously with multigroup SEMs. The differentiation grade was scored according to well as 1, mod as 2, or por as 3, ly as negative 0 or positive 1, v as negative 0 or positive 1, and n as negative 0 or positive 1. All data were retrospectively retrieved from the pathological reviews and medical records.

Matrilysin immunohistochemistry and evaluation

Archival formalin-fixed, paraffin-embedded sections were immunostained using a standard avidin-biotin peroxidase technique using LSAB2 System-HRP (Dako, Glostrup, Denmark) as recommended by the manufacturer. The mouse monoclonal antibody was against human matrix metalloproteinase-7 (also known as matrilysin) (141-7B2; Daiichi Fine Chemical, Toyama, Japan). The simplest criterion to evaluate immunoreactivity was adopted according to an all-or-nothing principle. Matrilysin immunostaining was judged as positive provided basilar and/or cytoplasmic staining were observed at the invasive edge. Avoiding observer bias, two independent researchers (KO and KY) evaluated all immunostaining in a blinded manner.

Data analysis

Descriptive statistics were summarized as frequency distributions for categorical data, and the means and standard deviations for continuous data. For descriptive purposes, univariate statistics were conducted using the demographic characteristics. Demographic data such as age, gender, tumor size, depth of penetration, tumor grade, ly, v, n, and matrilysin expression were correlated to examine their statistical associations (statistical significance: P < 0.05).

Non-recursive SEMs of GI cancers are depicted in Figs 13. The three latent variables, F1–3, were identified by exploratory factor analysis (EFA) with a direct oblimin rotation as a precursor to confirmatory factor analysis (CFA). The seven pathologic parameters, including ly, v, n, depth of penetration, matrilysin expression, tumor size, and histological grade, were introduced into the SEM analysis as observed variables. The model was statistically evaluated by t-tests of all paths, and r2 values or squared multiple correlations were calculated. Moreover, the model was modified by the multivariate Largrange Multiplier and Wald test [16]. There were no missing data in this SEM analysis. Detailed handling of binary data in ordinal or categorical variables, such as v, ly, n, depth, matrilysin expression, and grade, is not explained here but depends on modification of the ‘‘Lee- Poon-Bentler” approach using polychoric and polyserial correlation coefficients [17]. Statistical parameter estimation employed the maximally likelihood method with the ‘‘ROBUST” option implemented in the software [18] (See Text 1 in S1 File for details). To evaluate how well the model fit with the data, the comparative fit index (CFI), and root mean square error of approximation (RMSEA) were used as goodness-of-fit indices. According to conventional criteria, CFI >0.95 and RMSEA <0.08 indicate an acceptable fit, and CFI >0.97 and RMSEA <0.05 indicate a good fit [19]. Sample size was determined by a general rule of thumb that is that the minimum sample size should be preferably no less than 200 or 5–20 times the number of parameters to be estimated [20]. Power analysis of the SEM was performed using a web utility to generate the R code that can compute the statistical power for testing a covariance structure model using RMSEA [21]. All statistical analyses were conducted using EQS 6.2 (Multivariate Software, Inc., Encino, CA) [18], SPSS Statistics 21 (International Business Machines Corporation, Armonk, NY), and R (Available via http://www.R-project.org) [22]. Unfortunately, an extension of sensitivity analysis is not yet implemented in EQS.

thumbnail
Fig 1. SEM of esophageal cancer.

Circles indicate unobserved latent variables, while rectangles represent observed variables. Yellow indicates a dependent endogenous variable and grey indicates an independent exogenous variable. Significant paths with their estimated parameter are shown by solid lines, while insignificant paths are shown by broken lines (Fig 2). Rred arrows represent either a negative causal effect or measurement errors within the model. The blue triangle in the center suggests that the malignant potential includes three latent variables. Coefficient of determination is written as R2. Abbreviations: v, vascular invasion; ly, lymphatic invasion; n, lymph node metastasis; hist, histological grade.

https://doi.org/10.1371/journal.pone.0149327.g001

thumbnail
Fig 2. SEM of gastric cancer.

Circles indicate unobserved latent variables, while rectangles represent observed variables. Yellow indicates a dependent endogenous variable and grey indicates an independent exogenous variable. Significant paths with their estimated parameter are shown by solid lines, while insignificant paths are shown by broken lines (Fig 2). Rred arrows represent either a negative causal effect or measurement errors within the model. The blue triangle in the center suggests that the malignant potential includes three latent variables. Coefficient of determination is written as R2. Abbreviations: v, vascular invasion; ly, lymphatic invasion; n, lymph node metastasis; hist, histological grade.

https://doi.org/10.1371/journal.pone.0149327.g002

thumbnail
Fig 3. SEM of colorectal cancer.

Circles indicate unobserved latent variables, while rectangles represent observed variables. Yellow indicates a dependent endogenous variable and grey indicates an independent exogenous variable. Significant paths with their estimated parameter are shown by solid lines, while insignificant paths are shown by broken lines (Fig 2). Red arrows represent either a negative causal effect or measurement errors within the model. The blue triangle in the center suggests that the malignant potential includes three latent variables. Coefficient of determination is written as R2. Abbreviations: v, vascular invasion; ly, lymphatic invasion; n, lymph node metastasis; hist, histological grade.

https://doi.org/10.1371/journal.pone.0149327.g003

Results

Characteristics of GI cancer patients

As shown in Table 1 in detail, ECA patients were predominantly male. The tumor size of CRC was significantly smaller than that of other GI cancers. ECA was likely to penetrate massively into the submucosal layer, whereas CRC was likely to penetrate slightly. GCA was likely to differentiate poorly compared with the other GI cancers. ECA invaded infrequently into the vasculature. Lymph node metastases were observed in ECA, GCA, and CRC, in that order of frequency.

Independent predictive factors for lymph node metastasis identified by logistic regression analysis were as follows: depth of penetration (P = 0.01), ly (P = 1.0E-4), and tumor matrilysin expression (P = 0.04) for ECA; depth of penetration (P = 0.02), ly (P = 4.5E-5), matrilysin (P = 0.01) for GCA; v (P = 0.03), and matrilysin (P = 1.44E-4) for CRC. It was noteworthy that matrilysin expression was the only negative predictor in GCA (Table 2).

thumbnail
Table 2. Predictive factors for lymph node metastasis in GI cancers.

https://doi.org/10.1371/journal.pone.0149327.t002

Hypothesis I: Is malignant potential determined by common latent variables?

Because we did not have a substantial theoretical model concerning the undefined malignant potential of GI cancers, EFA was first performed for each type of GI cancer. As shown in Table 3, the scree test identified the three latent variables that we defined as key components of the malignant potential in each type of GI cancer. In ECA, two of the three latent variables designated as invasiveness and stemness were exogenous variables (Fig 1), whereas one of the three latent variables designated as stemness was an exogenous variable in GCA (Fig 2) and CRC (Fig 3). Because the exogenous (independent) variables were not affected by other variables, these results may reflect more autonomous progression of ECA than the other GI cancers. CFA was subsequently performed with direct oblimin rotation [23]. It was noteworthy that cancer stemness in both GCA and CRC negatively regulated cancer viability, whereas ECA stemness facilitated viability. Furthermore, GCA stemness could directly inhibit lymph node metastasis. These results suggested that GCA and CRC stemness partially maintain the normal stem cell niche property of tight control to prevent abnormal stem cells from proliferating uncontrollably. In contrast, ECA stemness lost such niche control and enhanced cancer viability. The malignant potential of ECA was more autonomous and higher than that of other GI cancers. In CRC, it was difficult to define the malignant potential by the same three variables in both ECA and GCA, and introduction of a new latent variable, ‘metastaticity’, was necessary. Consequently, there were substantial differences among the malignant potentials of the examined GI cancers.

Hypothesis II: Is there substantial differences in the associations between malignant potential and pathologic parameters?

Because configural invariance across GI cancer groups was not approved, multigroup SEM [24] could not be performed, which strongly suggested that there were substantial differences in each type of GI cancer in the SEM. For example, in ECA, we could trace the three paths on the causal graph from a causal ancestor (invasiveness and stemness) to a causal descendant (lymph node metastasis): invasiveness → ly → n, invasiveness → depth → n, stemness → viability → matrilysin → n. In GCA, we could trace the only significant path from stemness to lymph node metastasis, which was likely to negatively regulate lymph node metastasis. In CRC, we could trace the only path from metastaticity to lymph node metastasis.

Based on power analysis of the SEM with an α-level of 0.05, the estimated power of ECA, GCA, and CRC SEM was calculated as 0.997, 0.997, and 0.678, respectively [21]. Goodness-of-fit indices of the established models were as follows: CFI = 1.000 and RMSEA = 0.000 in ECA, CFI = 0.974 and RMSEA = 0.065 in GCA, CFI = 0.909 and RMSEA = 0.113 in CRC.

Discussion

We tested two hypotheses in this SEM. Hypothesis I is that the malignant potential of pT1 GI cancers is determined by three latent variables including stemness, invasiveness, and viability. Because the latent variables were disparate except for the number of variables in the examined GI cancers, hypothesis I was rejected. Despite this result, the SEM indicated that the malignant potential could be defined in combination with the latent variables introduced in the study. Hypothesis II is that there are substantial differences in the associations between malignant potential and pathological parameters according to the origin of the cancers. Because configural invariance across the GI cancer groups was not approved in a multigroup SEM analysis, this hypothesis was verified.

Unfortunately, despite many histological studies, we still cannot exactly assess the metastatic potential of cancer [25]. Assessment and prediction of the metastatic potential of cancer is difficult to evaluate directly. Fortunately, locoregional nodes are almost invariably the initial site of metastatic spread in pT1 GI cancers. Furthermore, pT1 GI cancers have a good prognosis compared to advanced stage disease. Therefore, the development of lymph node metastasis should reflect the metastatic and partly malignant potential of pT1 GI cancers. This is the rationale for the current study focusing on the malignant potential of pT1 GI cancers.

The goal of SEM analysis is to determine the extent to which the hypothesized model is supported by sample data. Although the current cross-sectional, observational data set cannot provide strong evidence of causation, one circumstance in which weak claims for causal inference can be made in the context of nonexperimental data is when there is temporal precedence between the predictor and criterion variables [26]. Because the predictor and criterion variables are correspond to the malignant potential represented by whole latent variables and lymph node metastasis (n), respectively, modest claims for causal inference between latent variables and lymph node metastasis can be made in our SEM analysis.

In ECA, we could trace the three paths on the causal graph from a causal ancestor (invasiveness and stemness) to a causal descendant (n), which were mediated through depth, ly, and matrilysin expression (Fig 1). Intriguingly, these parameters were in simultaneous accordance with predictive factors for lymph node metastasis identified by the logistic regression model (Table 2). In contrast to ECA, we could trace only a direct path from the latent variable to lymph node metastasis in both GCA and CRC, although the logistic regression model identified some predictive factors from observed variables. These results suggest that the causal inference of lymph node metastasis in both GCA and CRC largely remains to be clarified by further studies.

The malignant potential of ECA included two exogenous and one endogenous latent variables, whereas that of both GCA and CRC included one exogenous and two endogenous latent variables. Furthermore, cancer stemness promoted cancer cell viability in ECA, whereas it suppressed viability in both GCA and CRC. These results likely reflect a higher degree of malignant potential in ECA than the other GI cancers.

There are some limitations in this study. First, because evidence for causality is certainly the strongest in experimental designs with random assignment, further studies should be conducted with a longitudinal design. Second, in GCA, there were compellingly insignificant paths to lymph node metastasis as depicted by dotted lines in the developed model (Fig 2) because of ensuring goodness-of-fit in the established model [26]. Moreover, RMSEA in CRC was not less than 0.08. Further exploration of these models will be needed to resolve these issues. Third, it should be confirmed whether the authors’ latent variables were adequately designated by further SEM analyses. Fourth, clinicopathologic parameters, such as gender (S1 Table) and age (S2 Table), which were observed and exogenous variables, were excluded in this analysis because of avoiding complexity of the models and improper solutions. However, how gender or age affect the malignant potential of GI cancers in the other datasets warrants further SEM analyses, and this would be a very interesting question to be resolved in the near future. Fifth, statistical power more than 0.8 was required by recruiting more CRC patients. Finally, the clinical significance of tumor matrilysin expression remains to be clarified by further studies of GI cancers.

Conclusion

In conclusion, we examined the challenging issue of assessing the malignant potential of GI cancers. We hope that such information contributes to refining clinical treatments for GI cancers.

Supporting Information

S1 File. Normal, Polychoric and Polyserial Correlations.

https://doi.org/10.1371/journal.pone.0149327.s001

(DOCX)

S1 Table. Gender bias in the pathologic parameters.

https://doi.org/10.1371/journal.pone.0149327.s002

(DOCX)

S2 Table. Age bias in the pathologic parameters.

https://doi.org/10.1371/journal.pone.0149327.s003

(DOCX)

Acknowledgments

We thank Ms. E. Katahira of Sapporo Medical University for technical assistance.

Author Contributions

Conceived and designed the experiments: YA HT MH HI. Performed the experiments: HS KO KK SO JK HO. Analyzed the data: YA HT KY YS HI. Contributed reagents/materials/analysis tools: HS KO KK SO JK HO. Wrote the paper: YA YS MH HI.

References

  1. 1. Ancona E, Rampado S, Cassaro M, Battaglia G, Ruol A, Castoro C, et al. Prediction of lymph node status in superficial esophageal carcinoma. Ann Surg Oncol. 2008;15: 3278–3288. pmid:18726651
  2. 2. Pennathur A, Farkas A, Krasinskas AM, Ferson PF, Gooding WE, Gibson MK, et al. Esophagectomy for T1 esophageal cancer: outcomes in 100 patients and implications for endoscopic therapy. Ann Thorac Surg. The Society of Thoracic Surgeons; 2009;87: 1048–1054; discussion 1054–1055.
  3. 3. Sano T, Kodera Y. Japanese gastric cancer treatment guidelines 2010 (ver. 3). Gastric Cancer. 2011;14: 113–123. pmid:21573742
  4. 4. Ueno H, Hidetaka M, Hashiguchi Y, Shimazaki H, Shinsuke A, Kazuo H, et al. Risk Factors for an Adverse Outcome in Early Invasive Colorectal Carcinoma. Gastroenterology. 2004;127: 385–394.
  5. 5. Ajani JA, D’Amico TA, Almhanna K, Bentrem DJ, Besh S, Chao J, et al. Esophageal and Esophagogastric Junction Cancers. In: NCCN.org [Internet]. 2015. Available: http://www.nccn.org/professionals/physician_gls/pdf/esophageal.pdf
  6. 6. Ajani JA, D’Amico TA, Almhanna K, Bentrem DJ, Besh S, Chao J, et al. Gastric cancer. In: NCCN.org [Internet]. 2015. Available: http://www.nccn.org/professionals/physician_gls/pdf/gastric.pdf
  7. 7. Al B, Benson I, Venook AP, Bekaii-Saab T, Chan E, Chen Y-J, et al. Colon cancer. In: NCCN.org [Internet]. 2015. Available: http://www.nccn.org/professionals/physician_gls/pdf/colon.pdf
  8. 8. Al B, Benson I, Venook AP, Bekaii-Saab T, Chan E, Chen Y-J, et al. Rectal Cancer. In: NCCN.org [Internet]. 2015. Available: http://www.nccn.org/professionals/physician_gls/pdf/rectal.pdf
  9. 9. Kurokawa S, Arimura Y, Yamamoto H, Adachi Y, Endo T, Sato T, et al. Tumour matrilysin expression predicts metastatic potential of stage I (pT1) colon and rectal cancers. Gut. 2005;54: 1751–8. pmid:16284286
  10. 10. Jöreskog KG. A General method for estimating a linear structural equation system. ETS Res Bull Ser. 1970;1970: 1–41.
  11. 11. Bollen K, Noble MD. Colloquium Paper: Structural equation models and the quantification of behavior. Proc Natl Acad Sci. 2011;108: 15639–15646. pmid:21730136
  12. 12. Sobin LH, Gospodarowicz MK, Wittekind C. TNM Classification of Malignant Tumours. 7th Edition. Wiley-Blackwell; 2009.
  13. 13. Japan Esophageal Society. Japanese Classification of Esophageal Cancer, tenth edition: part I. Esophagus. 2009;6: 1–25.
  14. 14. Japanese Gastric Cancer Association. Japanese classification of gastric carcinoma: 3rd English edition. Gastric Cancer. 2011;14: 101–112. pmid:21573743
  15. 15. Japanese Society for Cancer of the Colon and Rectum. Japanese classification of colorectal carcinoma. Second Eng. Tokyo: Kanehara & CO., LTD.; 2009.
  16. 16. Buse A. The Likelihood Ratio, Wald, and Lagrange Multiplier Tests: An Expository Note. Am Stat. 1982;36: 153–157.
  17. 17. Lee SY, Poon WY, Bentler PM. A two-stage estimation of structural equation models with continuous and polytomous variables. Br J Math Stat Psychol. 1995;48 (Pt 2): 339–58. pmid:8527346
  18. 18. Bentler PM, Wu EJC. EQS 6.1 for Windows User’s Guide. 2008; 1–26.
  19. 19. Bollen KA, Long JS. Testing Structural Equation Models. In: SAGE Publications, Inc [Internet]. 1993. Available: http://www.uk.sagepub.com/books/Book3893
  20. 20. Lei P-W, Wu Q. Introduction to Structural Equation Modeling: Issues and Practical Considerations. Educ Meas Issues Pract (ITEMS Modul. 2007;26: 33–43.
  21. 21. Preacher KJ, Coffman DL. Power and Sample Size using RMSEA [Internet]. 2006. Available: http://quantpsy.org/rmsea/rmsea.htm
  22. 22. Ihaka R, Gentleman R. R: A Language for Data Analysis and Graphics. J Comput Graph Stat. 1996;5: 299–314.
  23. 23. Dean J. Choosing the Right Type of Rotation in PCA and EFA. Shiken JALT Test Eval SIG Newsl. 2009;13: 20–25.
  24. 24. Bou JC, Satorra . A Multigroup Structural Equation Approach: A Demonstration by Testing Variation of Firm Profitability Across EU Samples. Organ Res Methods. 2010;13: 738–766.
  25. 25. Liefers GJ, Liefers GJ, Cleton-Jansen a. M, Cleton-Jansen M, van De Velde CJH, van De Velde CJH, et al. Micrometastases and survival in stage II colorectal cancer. N Engl J Med. 1998;339: 223. pmid:9673300
  26. 26. Bryan A, Schmiege SJ, Broaddus MR. Mediational analysis in HIV/AIDS research: Estimating multivariate path analytic models in a structural equation modeling framework. AIDS Behav. 2007;11: 365–383. pmid:16917669