Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Psychometric validation study of the Korean version of the Functional Assessment of Cancer Therapy-Vanderbilt Cystectomy Index

  • Myong Kim,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Visualization, Writing – original draft

    Affiliation Department of Urology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea

  • Seung-June Oh,

    Roles Investigation, Methodology, Validation, Writing – review & editing

    Affiliation Department of Urology, Seoul National University Hospital, Seoul National University College of Medicine, Seoul, Republic of Korea

  • Cheol Kwak,

    Roles Investigation, Methodology, Validation, Writing – review & editing

    Affiliation Department of Urology, Seoul National University Hospital, Seoul National University College of Medicine, Seoul, Republic of Korea

  • Hyeon Hoe Kim,

    Roles Investigation, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Urology, Seoul National University Hospital, Seoul National University College of Medicine, Seoul, Republic of Korea

  • Ja Hyeon Ku

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Writing – original draft

    kuuro70@snu.ac.kr

    Affiliation Department of Urology, Seoul National University Hospital, Seoul National University College of Medicine, Seoul, Republic of Korea

Abstract

Purposes

To evaluate the reliability and validity of a Korean version of the Functional Assessment of Cancer Therapy (FACT)-Vanderbilt Cystectomy Index (VCI) in Korean patients who underwent radical cystectomy (RC) and urinary diversion (UD).

Materials and methods

We prospectively recruited 108 RC and UD patients who did not have evidence of recurrence from 1994 December to 2015 March. All participants were instructed to complete the Korean FACT-VCI and Short-Form 36-Item Health Survey (SF-36; 1st measurement) and to repeat the Korean FACT-VCI survey one month later (2nd measurement). Statistical analysis included intraclass correlation, Cronbach’s α, time and UD type fixed mixed linear model, principal components analysis, and criterion-related validity with SF-36.

Results

Korean FACT-VCI was internally consistent (α = 0.802) and had adequate test-retest reliability (interclass correlation = 0.803 and 0.822). The three components model of principal component analysis (cumulative explanatory power, 49.2%) confirmed the internal structural validity of the additional concerns (AC) component of the Korean FACT-VCI, and each component represented the “voiding problem”, “bowel problem”, and “social/functional problem with equivalent explanatory power (19.5%, 15.4%, and 14.4%). Korean FACT-VCI domain scores were generally well correlated with SF-36 domain scores (Pearson correlation coefficients range: 0.286–0.688; all p <0.01). Mixed linear models revealed that the major effect of measurement times was not significant on FACT-VCI (p = 0.589)

Conclusions

This prospective study confirms the reliability and validation of the Korean FACT-VCI. We expect that this validated tool can be widely utilized in the health-related quality of life studies of Korean patients.

Introduction

Radical cystectomy (RC) and urinary diversion (UD) remains the gold standard treatment for invasive bladder cancer [1,2]. But, RC and UD for bladder cancer is one of the most traumatic cancer surgeries causing psychological stress and alternation in life-style. Significant morbidities include sexual dysfunction, voiding problem, or change in body image [3]. Furthermore, extension of RC indications in high risk T1 diseases [1,2] and increasing long-term survival have increased the impact of the treatment on health-related quality of life (HRQOL).

Several studies have addressed HRQOL following RC [48]. However, the tools used to assess HRQOL were instruments for general disease [4,8] or other malignancies [7], or lacked external validation[5]. To address these shortcomings, Cookson et al. developed a novel questionnaire for patients receiving RC and UD. The questionnaire—the Functional Assessment of Cancer Therapy (FACT)-Vanderbilt Cystectomy Index (VCI)–is based on the FACT-General (FACT-G) questionnaire, whose reliability and validity have been confirmed [9], in addition to items for concerning distressing symptoms following RC [10]. The reliability and validity of the original version of FACT-VCI were also confirmed [10], and psychometric validation has been confirmed utilizing externally extended cohorts [11]. This validated questionnaire is now generally accepted as a credible tool for assessment of HRQOL in patients who have undergone RC and UD, and has been adopted in many HRQOL studies of bladder cancer [12,13].

In the process of translation of a questionnaire written in one language into a version in another language, the translated versions must reflect differences in the culture and custom of subjects who use a given language. In a first step toward obtaining a validated assessment tool for HRQOL of patients who underwent RC and UD in Korea, we previously performed the translation and linguistic validation of the Korean version of the FACT-VCI (Korean FACT-VCI), which consists of 27-items from the FACT-G component, and additional 17-items regarding RC-related concerns (FACT-AC component) [14]. As the next step, we prospectively performed the psychometric validation of Korean FACT-VCI to establish its reliability and validity in Korean populations.

Matrials and methods

Ethical statements

This prospective study was approved by the institutional review board (IRB) of Seoul National University Hospital (Approval No. H-1307-127-508), Seoul, Republic of Korea. All participants voluntarily agreed to participate in this study and signed a written informed consent form which was approved by our IRB. All personal information was anonymized before analysis.

Establishment of Korean version of FACT-VCI questionnaire

The original English version of the FACT-VCI consists of 27-items derived from the FACT-G (FACT-G component), which is divided into physical (GP), social/family (GS), emotional (GE), and functional well-being (GF) domains [9], in addition to 17-items regarding RC and UD-related concerns (FACT-AC component) that are specifically related to urinary, bowel, and sexual function [10]. We previously performed the translation and linguistic validation of Korean FACT-VCI [14]. Briefly, translation and linguistic validation were carried out according to permission for translation, forward translation, reconciliation, backward translation, cognitive debriefing, and final proof-reading [14].

Study populations

Population size was determined by referral to the previous proposed optimal subject-to-item ratios for internal component validation, which were suggested as being between 5:1 and 10:1 [15,16]. Patients who underwent RC and UC at our institution from 1994 December to 2015 March were prospectively recruited at least one month before the evaluation. Evidence of disease recurrence, illiteracy, history of psychical disorder, and withholding of consent to participate were exclusion criteria. All patients were instructed to complete the Korean FACT-VCI survey and the Korean version of the Short-Form 36-Item Health Survey (SF-36) version 2.0 on the first visit (1st measurement) [17,18], and to complete the Korean FACT-VCI in one month later (2nd measurement). Basic demographic and disease-related variable were also prospectively collected.

Reliability assessment

Test-retest reliability of the Korean FACT-VCI including 17-items of the FACT-AC component were determined by intraclass correlation coefficients with 95% confidence intervals (CIs), using samples of patients who completed the 1st and 2nd measurements. Cronbach’s α was estimated to assess whether the 17-items of the FACT-AC component had a value >0.70, which is considered indicative of internal consistency, using samples of persons who completed the 1st measurement [19]. A linear mixed model with a fixed measurement time and urinary diversion type was utilized to confirm the absolute agreement between repeated tests of the 17-items of the FACT-AC component.

Validity assessment

Principal components analysis was performed to determine the internal compositional validity of 16 gender-neutral items (item BL3, able to have erection, was excluded a male-only item) of the FACT-AC component. The varimax criterion was adopted for analytic rotation in this factor analysis [20]. Following a previous study [11] and recommendations [21,22], item loading ≥0.30 was considered as substantive in each component. External validity was confirmed by criterion-related association between the Korean FACT-VCI including the 17-items of the FACT-AC component and SF-36 version 2.0. Pearson’s correlation coefficients with p-values were estimated for that purpose [23]. All statistical analyses were performed using commercially available software (SPSS® version 21.0, Chicago, IL, United States).

Results

Demographics and clinical data

The study included 108 patients who met the inclusion criteria and who completed the 1st measurement (FACT-VCI and SF-36 questionnaires) at median of 7.3 months (interquartile range [IQR], 1.4–35.4) postoperatively. Median age at time of surgery was 66.8 years (IQR, 58.1–71.9). Of the 108 patients, 95 (88.0%) were male, 52 (48.1%) underwent orthotopic neobladder (ONB) and 56 (51.9%) received ileal conduit (IC) as UD. Among the recruited subjects, 14 (13.0%) could not complete the 2nd measurement (repeated FACT-VCI).

Reliability assessment

Table 1 presents the data for the Korean FACT-VCI item variance with its test-retest reliability and internal consistency. Patients showed the full range of responses (0–4), which varied according to each items. The mean scores of the FACT-G and FACT-AC component at 1st measurement was 68.9 (±13.9) and 37.5 (±13.9), respectively. The test-retest reliabilities of each domain were adequate (intraclass correlation coefficient range, 0.601–0.825). Internal consistency of 17-items of the FACT-AC component was assessed. Cronbach’s α indicated “good” internal consistency at the level of 0.802 in the FACT-AC component, and ranged 0.776 to 0.818 if one item was deleted (Table 1). Results of linear mixed model for repeated measurement of Korean FACT-VCI showed that main effects of measurement time (1st or 2nd) on AC component score were not significant (p = 0.589), while diversion type (ONB or IC) had trace effects on the score but failed to reach significance (p = 0.095; Table 2). The findings imply the absolute agreement between repeated tests of FACT-VCI.

thumbnail
Table 1. Korean version of the Functional Assessment of Cancer Therapy (FACT)-Vanderbilt Cystectomy Index (VCI) item variance with its test-retest reliability and internal consistency.

https://doi.org/10.1371/journal.pone.0190570.t001

thumbnail
Table 2. Differences in additional concerns (AC) component sum scores of Korean version of the Functional Assessment of Cancer Therapy (FACT)-Vanderbilt Cystectomy Index (VCI) scores by urinary diversion type with time.

https://doi.org/10.1371/journal.pone.0190570.t002

Principal components analysis for internal compositional validity assessment

Principal components analysis was performed to determine the internal compositional validity of 16 gender-neutral items of the FACT-AC component (Table 3). This model showed Bartlett’s test of sphericity (p <0.001) and Kaiser-Meyer-Olkin measure of sampling adequacy (0.718), indicating the adequacy of the model for factor analysis. Three components accounted for 49.3% of the total item covariance: “voiding problems”, “bowel problems”, “social/functional problems”. However, a single component solution accounted for only 27.6% of the total item covariance. All items except for C3 (diarrhea), ITU1 (comfortable discussing with friends), and BL4 (interest in sex) were substantial (varimax-rotated loading ≥0.3) with the one component solution.

thumbnail
Table 3. Principal components structure of data items for the additional concerns (AC) component of the Korean version of the Functional Assessment of Cancer Therapy (FACT)-Vanderbilt Cystectomy Index (VCI).

https://doi.org/10.1371/journal.pone.0190570.t003

Criterion-related validity in relation to the SF-36

Criterion-related validities of Korean FACT-VCI domains were also performed in relation to the SF-36 domain as follows: physical functioning (PF), role-functioning physical (RP), body pain (BP), general health (GH), vitality (VT), social functioning (SF), role-functioning emotional (RE), mental health (MH) domains, physical component summary (PCS), and mental health component summary (MCS). All domains of the FACT-G and FACT-AC components were significantly associated with related domains of the SF-36 (Pearson’s correlation coefficients range: 0.286–0.688; all p <0.01), except for associations between GS domain of the FACT-G component and related SF-36 domains (p = 0.775 and 0.057, respectively) and the FACT-AC component (p = 0.105; Table 4). Generally, the Korean FACT-VCI correlated well with the SF-36.

thumbnail
Table 4. Criterion-related validity of the Korean version of the Functional Assessment of Cancer Therapy (FACT)-Vanderbilt Cystectomy Index (VCI) in relation to the Short-Form 36-Item Health Survey (SF-36) version 2.0.

https://doi.org/10.1371/journal.pone.0190570.t004

Discussion

Although some other tools for HRQOL assessment in bladder cancer have been developed, such as the FACT-Bladder Cancer (FACT-BL) [24], European Organization for Research and Treatment of Cancer (EORTC) QLQ-BLS, EORTC QLQ-BLM [25], or the Bladder Cancer Index (BCI) [26], only the BCI has psychometric validation [26]. The reliability and validity of original English version of FACT-VCI has been established [10,11].

Reliability of original and Korean FACT-VCI

The test-retest reliability of FACT-VCI was first assessed by Cookson et al. [10]. The intraclass correlation coefficient of the AC component sum of the original FACT-VCI was 0.79, which indicated acceptable test-retest reliability [10]. A more recent psychometric validation study reported a higher correlation rate (ρ = 0.89; p <0.001) [11]. However, this higher rate may have been caused by the use of a different statistical methodology for the test-retest reliability assessment (Spearman correlation) [11]. Presently, we used similar methods as Cookson et al. [10] and demonstrated similar results (intraclass correlation coefficient = 0.822; Table 1). Therefore, the Korean FACT-VCI is concluded to have adequate test-retest reliability. Moreover, items of the FACT-G comportment also demonstrated ‘good’ reliability (intraclass correlation coefficient = 0.803; Table 1).

For the evaluation of internal consistency of the included items, the prior two studies similarly estimated the Cronbach’s α and reported similar values (0.85 and 0.854) [10,11]. Our study also adopted the same methodology, and showed a slightly lower but comparable rate of 0.802 (Table 1). Moreover, that rates were constant (0.776–0.818) if one item was deleted (Table 1), in agreement with one of the prior studies [11]. Therefore, we conclude that Korean FACT-VCI also has internal consistency among each item of the questionnaire.

To test the absolute agreement between repeated tests of FACT-VCI, a linear mixed model with the measurement time and urinary diversion type fixed was performed. The main effect of measurement time on the FACT-AC component score was not significant (p = 0.589; Table 2), which was consistent with the same finding by Cookson et al. that the main effect of measurement time was not significant (p = 0.66) [10]. However, our results differed in two points. First, the mean values of the AC component sum (37.5 and 38.2; Table 1) were slightly lower than those reported by Cookson et al. (44.38 and 45.21) [10]. The discrepancy is likely mainly due to the difference of patient characteristics. Our cohorts comprised of Asian populations with a shorter post-operative period (median 7.3 months) than the prior cohorts (more than one year) [10]. Second, our data showed trend toward better HRQOL in patients with IC than in patients with ONB (AC component score, 38.76 vs. 36.74; p = 0.095; Table 2), while the previous study demonstrated a trend toward compromised HRQOL in the IC cohort, compared with the ONB cohort (AC component score, 40.91 vs. 47.45; p = 0.08) [10]. However, Anderson et al. [11] and other researchers [26,27] reported similar results with us; patients with IC had better HRQOL outcomes compared to patients with ONB. These interesting findings that seemingly contradict common sense might be because of that some voiding problem-related items, such as BL1 (trouble controlling urine), ITU7 (condition wakes me up at night), VC1 (satisfied with urinary condition), or ITU2 (afraid to go far from toilet), can exaggerate the deterioration of HRQOL in ONB cohorts. However, to confirm this suggestion, a larger prospective study is needed.

Validity of original and Korean FACT-VCI

Principal components analysis results provide some interesting information regarding this questionnaire (Table 3). The three component model accumulatively accounted for 49.3% of total item covariance, and the rate was comparable with accumulative accounting rates (58.0%) of the three component models of Anderson et al. [11]. This prior model could not confirm the representative criteria of each components, perhaps because the model was made using patients in a preoperative setting [11]. However, our three components were “voiding problems”, “bowel problems”, and “social/functional problems” (Table 3). Moreover, these components provided equivalent explanation powers to the total score (19.5%, 15.4%, and 14.4%, respectively; Table 3), and cumulative explanation of its three components (49.3%) was higher than that of the single component model (27.6%). Therefore, we believe that the internal compositional validity of the Korean FACT-VCI is adequate.

In the results of criterion-related validities, FACT-AC component scores showed good associations with all domains of SF-36 and FACT-G component, except for the GS (social/familial well-being) domain (p = 0.105). The GS domain was not also associated with SF (social functioning) domain and MCS (mental health component summary) of SF-36 (p = 0.775 and 0.057, respectively; Table 4). Similar findings were previously observed in the original version of FACT-VCI, in which the FACT-AC component score was not associated with the GS domain score of FACT-G component [10]. Thus, the dissociation between the GS domain and other domains stem from inherent characteristics of GS domain items, rather than being due to mistranslation. However, since other domains were well correlated with each other, it can be concluded that the Korean FACT-VCI has external validity.

Limitations

Our study has some limitations. First, a substantial portion of the recruited subjects (14 of 108 subjects, 13.0%) did not complete the 2nd measurement. To ensure proper statistical power, we endeavored to include maximal numbers of patient with available data required for analysis [28]. Second, because our subjects were predominantly male (95 of 108 subjects, 88.0%), we could not conclude whether the Korean FACT-VCI is gender-neutral. Instead, we excluded gender-dependent item (BL3, able to have erection) from some analyses (Table 3). Lastly, our cohorts did not comprise other UD types, such as Kock or Indiana pouch procedure. Therefore, it is still unclear whether the Korean FACT-VCI is applicable for those patients.

Conclusions

This prospective study confirms the reliability and validation of the Korean FACT-VCI. The Korean FACT-VCI demonstrates comparable test-retest reliability, internal consistency, and internal and external validity compared to the original English version. This validated tool could be widely utilized in HRQOL studies of Korean patients with bladder cancer.

Acknowledgments

This study is supported by grant no 05-2013-0010 from Seoul National University Hospital Research Fund. Yu Kyoung Lee, Ha Young Kim, Yu Jin Lee, and Se Ra Park assisted with the development of the Korean version of FACT-VCI.

References

  1. 1. Clark PE, Agarwal N, Biagioli MC, Eisenberger MA, Greenberg RE, Herr HW, et al. Bladder cancer. J Natl Compr Canc Netw. 2013;11:446–475. pmid:23584347
  2. 2. Stenzl A, Cowan NC, De Santis M, Jakse G, Kuczyk MA, Merseburger AS, et al. The updated EAU guidelines on muscle-invasive and metastatic bladder cancer. Eur Urol. 2009;55:815–825. pmid:19157687
  3. 3. Månsson Å, Månsson W. When the bladder is gone: quality of life following different types of urinary diversion. World J Urol. 1999;17:211–218. pmid:10460403
  4. 4. Fujisawa M, Isotani S, Gotoh A, Okada H, Arakawa S, Kamidono S. Health-related quality of life with orthotopic neobladder versus ileal conduit according to the SF-36 survey. Urology. 2000;55:862–865. pmid:10840094
  5. 5. Gotoh M, Mizutani K, Furukawa T, Kinukawa T, Ono Y, Ohshima S. Quality of micturition in male patients with orthotopic neobladder replacement. World J Urol. 2000;18:411–416. pmid:11204260
  6. 6. Henningsohn L, Wijkström H, Steven K, Pedersen J, Ahlstrand C, Aus G, et al. Relative importance of sources of symptom-induced distress in urinary bladder cancer survivors. Eur Urol. 2003;43:651–662. pmid:12767367
  7. 7. Miyake H, Nakamura I, Eto H, Gotoh A, Fujisawa M, Okada H, et al. An evaluation of quality of life in patients who underwent orthotopic bladder replacement after cystectomy: comparison of ileal neobladder versus colon neobladder. Urol Int. 2002;69:195–199. pmid:12372887
  8. 8. Yoneda T, Igawa M, Shiina H, Shigeno K, Urakami S. Postoperative morbidity, functional results and quality of life of patients following orthotopic neobladder reconstruction. Int J Urol. 2003;10:119–125. pmid:12622705
  9. 9. Cella DF, Tulsky DS, Gray G, Sarafian B, Linn E, Bonomi A, et al. The Functional Assessment of Cancer Therapy scale: development and validation of the general measure. J Clin Oncol. 1993;11:570–579. pmid:8445433
  10. 10. Cookson MS, Dutta SC, Chang SS, Clark T, Smith JA, Wells N. Health related quality of life in patients treated with radical cystectomy and urinary diversion for urothelial carcinoma of the bladder: development and validation of a new disease specific questionnaire. J Urol. 2003;170:1926–1930. pmid:14532809
  11. 11. Anderson CB, Feurer ID, Large MC, Steinberg GD, Barocas DA, Cookson MS, et al. Psychometric characteristics of a condition-specific, health-related quality-of-life survey: the FACT-Vanderbilt Cystectomy Index. Urology. 2012;80:77–83. pmid:22608798
  12. 12. Vakalopoulos I, Dimitriadis G, Anastasiadis A, Gkotsos G, Radopoulos D. Does intubated uretero-ureterocutaneostomy provide better health-related quality of life than orthotopic neobladder in patients after radical cystectomy for invasive bladder cancer? Int Urol Nephrol. 2011;43:743–748. pmid:21336959
  13. 13. Large MC, Katz MH, Shikanov S, Jayram GT, Eggener SE, Steinberg GD. Orthotopic neobladder versus indiana pouch: a comparison of quality of life outcomes for females. J Urol. 2009;181:266.
  14. 14. Kim M, Lee H-E, Kim S-H, Cho SY, Jeong SJ, Oh S-J, et al. Korean version of the Functional Assessment of Cancer Therapy (FACT)-Vanderbilt Cystectomy Index (VCI): translation and linguistic validation. Urol J. 2014;11:1961–1967. pmid:25433475
  15. 15. Kline RB. Principles and practice of structural equation modeling. 4th ed. New York: The Guilford press; 2016.
  16. 16. Baggaley AR. Deciding on the ratio of number of subjects to number of variables in factor analysis. Multivar Exp Clin Res. 1983;6:81–85.
  17. 17. Han C-W, Lee E-J, Iwaya T, Kataoka H, Kohzuki M. Development of the Korean version of Short-Form 36-Item Health Survey: health related QOL of healthy elderly people and elderly patients in Korea. Tohoku J Exp Med. 2004;203:189–194. pmid:15240928
  18. 18. Park HJ, Kim S, Yong JS, Han SS, Yang DH, Meguro M, et al. Reliability and validity of the Korean version of Kidney Disease Quality of Life Instrument (KDQOL-SF). Tohoku J Exp Med. 2007;211:321–329. pmid:17409671
  19. 19. Nunnally JC, Bernstein IH. Psychometric theory 3rd ed. New York: McGraw-Hill; 1994.
  20. 20. Kaiser HF. The varimax criterion for analytic rotation in factor analysis. Psychometrika. 1958;23:187–200.
  21. 21. Hair JF Jr., Anderson RE, Tatham RL, Black WC. Multivariate data analysis. 5th ed. London, UK: Prentice-Hall International; 1998.
  22. 22. Stevens J. Applied multivariate statistics for the social science. 4th ed. Mahwah, NJ: Lawrence Erlbaum Associates; 2002
  23. 23. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. New York: Lawrence Eribaum Associates; 1988.
  24. 24. Cella D. FACIT manual: Manual of the Functional Assessment of Chronic Illness Therapy (FACIT) measurement system. 4th ed. IL: Evanston; Center on Outcomes Research and Education,; 1997.
  25. 25. European Organization for Research and Treatment of Cancer. Cancer QOL questionnaires. http://groups.eortc.be/qol.
  26. 26. Gilbert SM, Wood DP, Dunn RL, Weizer AZ, Lee CT, Montie JE, et al. Measuring health-related quality of life outcomes in bladder cancer patients using the Bladder Cancer Index (BCI). Cancer. 2007;109:1756–1762. pmid:17366596
  27. 27. Kulaksizoglu H, Toktas G, Kulaksizoglu IB, Aglamis E, Ünlüer E. When should quality of life be measured after radical cystectomy? Eur Urol. 2002;42:350–355. pmid:12361900
  28. 28. Hinkle DE, Wiersma W, Jurs SG. Applied Statistics for the Behavioral Sciences. 5th ed. Boston: Houghton Mifflin; 2003.