Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Open Access

Peer-reviewed

Research Article

Psychometric properties of the German version of the Leicester Cough Questionnaire in sarcoidosis

  • Jonas Christian Schupp,

    Roles Conceptualization, Investigation, Writing – original draft, Writing – review & editing

    Affiliations Department of Pneumology, Faculty of Medicine, University Medical Centre, Freiburg, Germany, Section of Pulmonary, Critical Care and Sleep Medicine, Yale University School of Medicine, New Haven, Connecticut, United States of America

    ⨯
  • Urs Alexander Fichtner,

    Roles Formal analysis, Writing – review & editing

    Affiliation Institute for Quality Management and Social Medicine, Faculty of Medicine, University Medical Centre, Freiburg, Germany

    ⨯
  • Björn Christian Frye,

    Roles Investigation, Writing – review & editing

    Affiliation Department of Pneumology, Faculty of Medicine, University Medical Centre, Freiburg, Germany

    ⨯
  • Katja Heyduck-Weides,

    Roles Formal analysis

    Affiliation Institute for Quality Management and Social Medicine, Faculty of Medicine, University Medical Centre, Freiburg, Germany

    ⨯
  • Surinder S. Birring,

    Roles Resources, Supervision, Writing – review & editing

    Affiliation Division of Asthma, Allergy and Lung Biology, King’s College London, London, United Kingdom

    ⨯
  • Wolfram Windisch,

    Roles Resources, Supervision, Writing – review & editing

    Affiliation Department of Pneumology, Cologne-Merheim Hospital, Kliniken der Stadt Köln gGmbH, Witten/Herdecke University Hospital, Cologne, Germany

    ⨯
  • Carl-Peter Criée,

    Roles Resources, Writing – review & editing

    Affiliation Department of Sleep and Respiratory Medicine, Evangelical Hospital Göttingen-Weende, Bovenden, Germany

    ⨯
  • Joachim Müller-Quernheim,

    Roles Conceptualization, Funding acquisition, Investigation, Supervision, Writing – review & editing

    Affiliation Department of Pneumology, Faculty of Medicine, University Medical Centre, Freiburg, Germany

    ⨯
  • Erik Farin

    Roles Conceptualization, Formal analysis, Investigation, Supervision, Writing – original draft, Writing – review & editing

    erik.farin@uniklinik-freiburg.de

    Affiliation Institute for Quality Management and Social Medicine, Faculty of Medicine, University Medical Centre, Freiburg, Germany

    ⨯

Abstract

Background

Cough is one of the most common symptoms in general and pulmonary medicine with profound negative impact on health-related quality of life (HRQL). The Leicester Cough Questionnaire (LCQ) is a validated HRQL questionnaire, yet a validated German version of the LCQ is not available and it has never been tested in a cohort with sarcoidosis.

Objectives

To translate the LCQ into German and determine its psychometric properties.

Methods

The LCQ was translated in a forward-backward approach. Structured interviews in sarcoidosis patients were performed. Subsequently, sarcoidosis patients were asked to answer the German LCQ and comparative questionnaires. Distribution properties, item difficulty, concurrent validity, Rasch model fit and internal consistency of the German LCQ were determined.

Results

200 patients with sarcoidosis were included. We provide evidence for reliability, unidimensionality and internal consistency. However, only a moderate correlation with general and respiratory-specific HRQL questionnaires, no Rasch model fit could be shown. Skewed responses caused by floor effects were detected.

Conclusion

We demonstrate that the German LCQ is valid and reliable and its psychometric properties fulfil the standards required for its use in clinical settings as well as in interventional trials.

Citation: Schupp JC, Fichtner UA, Frye BC, Heyduck-Weides K, Birring SS, Windisch W, et al. (2018) Psychometric properties of the German version of the Leicester Cough Questionnaire in sarcoidosis. PLoS ONE 13(10): e0205308. https://doi.org/10.1371/journal.pone.0205308

Editor: Chung-Ying Lin, Hong Kong Polytechnic University, HONG KONG

Received: July 24, 2018; Accepted: September 21, 2018; Published: October 4, 2018

Copyright: © 2018 Schupp et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All relevant data are within the paper and its Supporting Information files.

Funding: This study was made possible by intramural funding. This manuscript was partially supported by the German Research Foundation (SCHU 3147/1) to JCS. The article processing charge was funded by the German Research Foundation (DFG) and the University of Freiburg in the Open-Access Publishing funding programme. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

Cough is one of the most common symptoms in general and pulmonary medicine and has a profound negative impact on health-related quality of life (HRQL) in affected patients[1]. Patients with chronic cough suffer from physical illness, like chest pain, syncope and incontinence, and psychological morbidity, like social embarrassment and depression[2]. A myriad of diseases can cause chronic cough, common diseases like asthma or gastroesophageal reflux disease or rare diseases like sarcoidosis.

Sarcoidosis is a systemic granulomatous disease of unknown aetiology[3]. Patients with sarcoidosis typically suffer from pulmonary symptoms like cough, dyspnoea or chest pain with subsequent reduction of their general health status and their respiratory-specific HRQL[3–6]. Cough is a common symptom in patients with sarcoidosis, with up to 50% affected patients [6–8]. Bronchial involvement, which can be demonstrated histologically, is supposed to be causative for cough in sarcoidosis patients[9]. In sarcoidosis, endpoints of clinical studies differ either depending on organ involvements or on general sarcoidosis symptoms like fatigue[10]. As symptoms like cough are difficult to be quantified objectively and usually accompanied with psychological morbidity, patient-reported outcomes should be implemented, at least as secondary endpoint, in clinical trials. The inclusion of measurements of HRQL in clinical trials is thus recommended by the World Association of Sarcoidosis and Other Granulomatous disease (WASOG)[10].

The Leicester Cough Questionnaire (LCQ) is a validated HRQL questionnaire on cough with three domains covering physical, psychological and social aspect of chronic cough[11]. The minimal important difference of the LCQ has already been established[12]. The LCQ has been translated into several languages including Dutch, Korean, Lithuanian, Mandarin, Polish, Portuguese and Spanish, and validated in corresponding cohorts[13–22]. It has been validated in different diseases, like chronic cough itself, cystic fibrosis including in children, bronchiectasis and COPD, yet not in a sarcoidosis cohort[20,23–25]. Furthermore, a revised version, the LCQ-acute, was developed for patients with acute cough[26].

The LCQ was already applied in several clinical studies on chronic cough testing different drugs including azithromycin, esomeprazole and itraconazole[27–29], as well as in a positive clinical study proving that morphine is an effective antitussive in chronic cough[30]. At the moment, it is in use in several clinical trials like in azithromycin in chronic productive cough (ClinicalTrials.gov Identifier: NCT02196493), amikacin in acute exacerbation of bronchiectasis (NCT02509091) or dornase alpha after lung transplantation (NCT01952470).

Taken together, the LCQ has been translated in multiple languages and validated in several diseases and is utilized in several completed and ongoing clinical studies, yet a validated German version of the LCQ is not available and it has never been tested in a cohort with sarcoidosis. Therefore, we aimed to translate and validate a German version of the LCQ in sarcoidosis patients to provide an instrument for future multinational observational and interventional studies on chronic cough and in particular in sarcoidosis.

Methods

Translation

In order to translate the LCQ[11] into German and validate it in a German cohort a multistep forward-backward approach was chosen[31]: First, the English version of the LCQ was independently translated by five authors (EFG, JMQ, JCS, WW, CPC), merged to a preliminary version followed by a backward translation by a native speaker. Some suggestions of the original author (SSB) were implemented, and afterwards the conceptual and cultural equivalence was confirmed by him. This German pilot version was tested in structured interviews of ten patients with sarcoidosis. Minor, final modifications based on these structured interviews were implemented and documented.

Subjects

200 consecutive sarcoidosis patients of at least 18 years of age diagnosed of sarcoidosis according to the consensus statement of three scientific societies (ERS, ATS, WASOG)[32] were recruited over 12 months in the outpatient clinic of the department of pneumology of the university medical centre Freiburg. We obtained a positive vote by the Ethics Committee of the Albert Ludwig University of Freiburg, Freiburg, Germany prior to the initiation of the study and it was registered in the German Clinical Trials Register (reference number DRKS00010072).

Study procedure

The participants were asked the following questionnaires and measurements: the LCQ in German, the Short Form (36) Health Survey (SF-36)[33], the Borg dyspnoea scale (CR-10)[34] and the visual analogue scale for dyspnoea (VAS-D)[35]. Furthermore, patients answered structured questions on their nationality, sex, duration of the disease, days of sickness per year, highest educational certificate, employment and family status.

Statistical analysis

Our approach follows the original publication of the LCQ and another validation paper in the Dutch context[11,24].

Distribution properties.

To give descriptive information and distribution properties, nonresponse rates, item difficulty, skewness and kurtosis were computed. Items with inappropriately high item difficulty, skewness or kurtosis as well as items with ceiling or floor effects were determined. Regarding the classification of ceiling and floor effects, we follow the approach of McHorney & Tarlov, Varni et al, and Lin et al defining a percentage of 0 to 15% as small, 16% to 30% as moderate and more than 30% as substantial floor or ceiling effect [36–38].

Item difficulty.

In order to check for item difficulty, we computed the item difficulty index [39] using the sum of squared item values divided by the sum of squared maximum values. The calculated index ranges from 0 to 1 and is sensitive to the variance of multiscale items.

Confirmatory factor analysis.

We conducted a confirmatory factor analysis using IBM SPSS AMOS 24 software to confirm the item-factor-relationship. A three-factor solution (corresponding to the assumed three constructs of the LCQ) was tested, based on a Maximum Likelihood estimation. Model fit was evaluated using Chi2 goodness of fit test, the Comparative Fit Index (CFI)[40], Tucker–Lewis index (TLI)[41], root mean square error of approximation (RMSEA), and standardized root mean square residual (SRMR). A non-significant Chi2 test indicates that the assumed model fits well the data. CFI and TLI values > 0.90 are considered as indication of good fit. RMSEA values <0.10 suggest a moderate fit; values <0.05 are a good fit[40]. The SRMR value should be under 0.08[40]. Satisfactory model fit is assumed whenever at least three out of four parameters produce good values[42]. In order to improve model fit, we additionally test a modified model. In order to do this, modification indices were explored to suggest residual correlations entailing a substantial improvement of fit [43]. However, we considered only changes if they were theoretically plausible.

Item response theory (IRT) analyses.

We used the 1-parameter logistic IRT model (Rasch model) for item response theory analyses (software: WINSTEPS version 3.68), as it is an effective tool for clinical applications[44]. Following Reeve et al.[45], we chose a partial credit model as it also provides stable parameter estimates for even small case numbers and furthermore because the response categories are not identical for all items [45,46]. Infit and outfit mean square residual statistics (Infit MNSQ, Outfit MNSQ) were used as goodness-of-fit statistics. Mean squares greater than 1.0 indicate underfit to the Rasch model, meaning that a part of the model’s variance lies outside the underlying factor concept. Mean squares less than 1.0 indicate overfit to the Rasch model, meaning that the data is more predictable than the model expects [47,48]. For survey rating scales a suitable item mean-square range from 0.6 to 1.4 is recommended [47]. Items with a poor infit or outfit were discussed. Additionally, we checked for disordered response categories in the items by calculating the ability means for each item in WINSTEPS [48]. Disorder might occur for example if respondents find it difficult to differentiate between the various response categories for a particular item [49].

Internal consistency.

Cronbach’s Alpha was calculated. Values between 0.7 and 0.8 can be considered as good, values between 0.90 and 0.95 as excellent. Values higher than 0.95 indicate item redundancy [50,51]. Item-total correlation >0.4 indicates that the item is adherent to other items measured using the same latent construct [52]. Concurrent validity: To evaluate concurrent validity, we tested the hypotheses below:

  1. As the Borg scale and the VAS Dyspnoea assess lung symptoms, we expect moderate (negative) correlations (0.30> = r>0.5) of these parameters with the LCQ scales.
  2. We expect high correlations (r> = 0.60) between the LCQ subscale “Physical” and the SF-36 Physical component scales, as well as between the LCQ subscales “Psychological” and “Social” and the SF-36 Mental component scales.

Results

Structured interviews

A pilot German LCQ was field-tested in ten patients with sarcoidosis by structured interviews. No patients had problems with understanding or answering the questionnaire. Some minor modifications were made in the final German LCQ to improve the comprehensibility of the questionnaire.

Patient characteristics

200 patients with sarcoidosis were included in this study. We identified 5 cases with complete missing values on the 19 LCQ items and 2 cases with missing values on more than 50% of the LCQ items. By removing those seven cases from the analysis we ended up with a sample size of 193 patients. 48.7% of the patients were females, the mean age was 52.9 (± 12.6) years (see Table 1). 33.9% of the patients were unemployed, and in 30.1% of the patients the educational level corresponded to that of primary school. The majority of the patients (83.7%) suffered from a chronic course of their disease with at least three years of illness duration.

thumbnail
Download:
Table 1. Patient characteristics.

https://doi.org/10.1371/journal.pone.0205308.t001

Distribution properties

In sum, 172 patients (86%) completed all 19 LCQ items. Overall, all items show low non-response rates with the highest rate (3.1%) on item number 9 (see S1 Table). All but one (item 15) items show floor effects with more than 30% of responses in the extreme categories indicating that the observed population is quite healthy. Both Skewness and Kurtosis lie in the range of -1.95 to +1.95 for almost all items except for item number 12 and 17. In those two items, the Kurtosis is slightly higher than the cut-off point.

Item difficulty

Item difficulty values are considered as good when they score between 0.2 and 0.8. Higher values indicate that items are too easy and lower values indicate that items are too difficult. All index values lie in this range except for items 12, 14 and 17, which have high values indicative for being too easy (see S2 Table). The highest index value is reached for item number 12 with 0.83.

Item response theory (IRT) analyses

Items were tested for Rasch model fit. Infit and outfit values that were beyond acceptable cut-offs were detected for items 3, 4, 5, 9, 11, 15 and 16. Inspection of the ability means for each item demonstrate disordered response thresholds for items 1, 4, 9, 13, 14, 15, 17 and 18. Overall, the LCQ does not fit to the probabilistic distribution of item response theory.

Confirmatory factor analysis

Table 2 shows model fit statistics as a result of the confirmatory factor analysis. The original model showed barely satisfactory fit (p<0.001, TLI = 0.88, CFI = 0.9, RMSEA = 0.11). As modification indices suggested that model fit would be improved if correlated error terms were added, we identified three error term correlations we consider as reasonable. Two items refer to insomnia (physical subscale) and general frustration (psychological subscale) which might highly correlate and have a joint component not entirely explained by the underlying factors. Two other items comprise both the term “sorrow” (psychological subscale) which might cause high correlations. The last two items (Social subscale) we correlated refer to the impact of cough on general life aspects. We modified the model accordingly so that the new model shows improved model fit with a decreased Chi2 value of 298.84 and satisfactory TLI and CFI values above 0.9. RMSEA decreased to 0.10. The Chi2 test still suggests no good model fit. However, Chi2 tests have been found to be too sensitive to large sample sizes [37,53,54]. Therefore, we rely more to the other applied model fit indices and consider the modified model as satisfactory.

thumbnail
Download:
Table 2. Global fit indices of confirmatory factor analysis.

https://doi.org/10.1371/journal.pone.0205308.t002

Internal consistency

Indicators for internal consistency are represented in Table 3. Cronbach’s Alpha is good to excellent for all three subscales of the LCQ (Cronbach’s alpha ranging from 0.87 to 0.94). The Item-total correlation falls below the acceptable range for the subscale “Physical” (0.24 to 0.74). We found that Cronbach’s Alpha of 0.87 would not decrease if item 15 would be eliminated. However, the mean inter-item correlation coefficient values do not fall below 0.44 so that we conclude that no items should be eliminated. Nevertheless, it should be mentioned that the subscale “physical” was the one with the weakest performance regarding internal consistency.

thumbnail
Download:
Table 3. Internal consistency.

https://doi.org/10.1371/journal.pone.0205308.t003

Concurrent validity

As expected in hypothesis 1, we observed moderate correlations with Borg scale and the VAS Dyspnoea, with a Pearson’s r around -0.5 (details see Table 4). However, we detected significant negative correlations with all LCQ subscales. Hypothesis 2 cannot be confirmed, since the assumed correlations were only moderate. The correlations are significant and in the right direction, but all of them are only moderate and do not reach a Pearson’s r of 0.6.

thumbnail
Download:
Table 4. Concurrent validity.

https://doi.org/10.1371/journal.pone.0205308.t004

Discussion

In this study, we translated the LCQ into German language, and examined its psychometric properties in a sarcoidosis cohort. We had sufficient information to analyse 193 out of 200 included patients, which is an acceptable rate for a validation study. In addition, the overall response rates were high. Only item number 9 had a relatively higher non-response frequency, which can be the result of the specific situation as the question asks for exposure to paints or fumes. This situation does not apply for every patient. Furthermore, we observed floor effects in most of the items which indicates that either the chosen reference time (2 weeks) might be too short or the patients overall show no severe health problems. The lowest response category however represents “Never/not at all” which cannot be differentiated any more.

The internal consistency of the German LCQ was good to excellent, with Cronbach’s Alphas between 0.87 to 0.94 for the three subscales. The high internal consistency of the German LCQ, as well as the moderate concurrent validity compared to general health or respiratory-specific HRQL questionnaires, is in line with published data, after translation into several other languages[15,16,19,22,55] as well as in the original LCQ[11]. In this regard it is astonishing that the Physical Component Summary Score (PCS) of the SF-36 showed a quite high correlation with the LCQ, while the Mental Component Summary Score (MCS) does not. This might indicate that the LCQ does measure HRQL aspects which are not covered by the SF-36 emphasizing the importance not only to use the SF-36, but also the LCQ. Here, a moderate correlation does not necessarily mean moderate validity.

The strengths of this study are the use of up-to-date patient reported outcome methodology, including item response modelling and confirmatory factor analyses, and to reach such a sample size in a specific patient group, which was sufficient for the statistical analyses conducted. The main limitations of this study are floor effects mainly because sarcoidosis patients were included regardless of the presence of cough. The moderate concurrent validity and missing Rasch model fit might therefore be attributable to our cohort and might improve if the German LCQ would be applied in a cohort suffering from more severe cough or higher cough frequencies. Further limitations are the following: Patients answered the questionnaire only once, so we cannot evaluate the test-retest-reliability. Additionally, CFA might have suffered from a insufficient sample size [56]. A validation cohort is missing, especially to confirm the good model fit in the CFA. Furthermore, we do not have objective data on physiological parameters of cough, like cough frequency, spectra or duration, which might show improved concurrent validity of the LCQ. And last, we only included patients with sarcoidosis which limits the generalizability of our results for patients with cough as a symptom of other diseases but demonstrates unequivocally its usefulness for measuring sarcoidosis associated cough.

In conclusion, we validated the German LCQ and could show that the psychometric properties of the German LCQ are acceptable for its general application and good for its use in sarcoidosis studies. We provide evidence for reliability, unidimensionality and internal consistency. However, some limitations might raise concerns. Only a moderate concurrent validity, and no Rasch model fit were detected. Furthermore, we found strong floor effects that indicate that the LCQ has limitations regarding its applicability in an asymptomatic sarcoidosis population. However, the moderate concurrent validity is in agreement with the concurrent validity in various other cohorts. Further testing is needed in order to confirm the discriminatory power between the subscales “Physical”, “Psychological” and “Social”. Disregarding the problem of construct validity, we suggest further investigating external validity and possible scale transformations in order to reach Rasch model fit. Further research with larger sample sizes is needed to investigate test-retest reliability and Rasch model fit. The German LCQ is valid, reliable, and ready to use in clinical settings as well as in pharmacological trials.

Supporting information

S1 Table. Items analysis: German version of the Leicester Cough Questionnaire (LCQ).

https://doi.org/10.1371/journal.pone.0205308.s001

(DOCX)

S2 Table. Item difficulty.

https://doi.org/10.1371/journal.pone.0205308.s002

(DOCX)

Acknowledgments

We thank every participant of this study, Nicole Wehrle for the structured interviews, Oliver Buchholz for the digitization of the questionnaires, and Carole Cürten for the backtranslation into English. Furthermore, we thank Renate Braune, Dr. rer. nat. Bernd Quadder and Doris Eisele of the German sarcoidosis self-help association (Deutsche Sarkoidose-Vereinigung) for their support in recruiting the cohort.

References

  1. 1. Simpson CB, Amin MR. Chronic Cough: State-of-the-Art Review. Otolaryngol Neck Surg. 2006;134: 693–700. pmid:16564398
  2. 2. Chamberlain SAF, Garrod R, Douiri A, Masefield S, Powell P, Bücher C, et al. The Impact of Chronic Cough: A Cross-Sectional European Survey. Lung. 2015;193: 401–408. pmid:25787221
  3. 3. Valeyre D, Prasse A, Nunes H, Uzunhan Y, Brillet P-Y, Müller-Quernheim J. Sarcoidosis. Lancet. 2014;383: 1155–67. pmid:24090799
  4. 4. Cox CE, Donohue JF, Brown CD, Kataria YP, Judson MA. Health-related quality of life of persons with sarcoidosis. Chest. 2004;125: 997–1004. pmid:15006960
  5. 5. Drent M, Wirnsberger RM, Breteler MH, Kock LM, de Vries J, Wouters EF. Quality of life and depressive symptoms in patients suffering from sarcoidosis. Sarcoidosis Vasc Diffuse Lung Dis. 1998;15: 59–66. pmid:9572003
  6. 6. Schupp JC, Freitag-Wolf S, Bargagli E, Mihailović-Vučinić V, Rottoli P, Grubanovic A, et al. Phenotypes of organ involvement in sarcoidosis. Eur Respir J. 2018;51: 1700991. pmid:29371378
  7. 7. Sinha A, Lee KK, Rafferty GF, Yousaf N, Pavord ID, Galloway J, et al. Predictors of objective cough frequency in pulmonary sarcoidosis. Eur Respir J. European Respiratory Society; 2016;47: 1461–1471.
  8. 8. Judson MA, Chopra A, Conuel E, Koutroumpakis E, Schafer C, Austin A, et al. The Assessment of Cough in a Sarcoidosis Clinic Using a Validated instrument and a Visual Analog Scale. Lung. 2017;195: 587–594. pmid:28707109
  9. 9. Harrison NK. Cough, sarcoidosis and idiopathic pulmonary fibrosis: raw nerves and bad vibrations. Cough. 2013;9: 9. pmid:23497330
  10. 10. Baughman RP, Drent M, Culver DA, Grutters JC, Handa T, Humbert M, et al. Endpoints for clinical trials of sarcoidosis. Sarcoidosis Vasc Diffuse Lung Dis. 2012;29: 90–8. pmid:23461070
  11. 11. Birring SS, Prudon B, Carr AJ, Singh SJ, Morgan L, Pavord ID. Development of a symptom specific health status measure for patients with chronic cough: Leicester Cough Questionnaire (LCQ). Thorax. 2003;58: 339–343. pmid:12668799
  12. 12. Raj AA, Pavord DI, Birring SS. Clinical Cough IV: What is the Minimal Important Difference for the Leicester Cough Questionnaire? Handbook of experimental pharmacology. 2009. pp. 311–320. pmid:18825348
  13. 13. Huisman AN, Wu M-Z, Uil SM, van den Berg JWK. Reliability and validity of a Dutch version of the Leicester Cough Questionnaire. Cough. 2007;3: 3. pmid:17313670
  14. 14. Merkytė I, Biekšienė K, Vagulienė N, Sakalauskas R. Reliability and Validity of a Lithuanian version of Leicester Cough Questionnaire. J Lung, Pulm Respir Res. MedCrave Online; 2016;3: 1–3.
  15. 15. Dąbrowska M, Krakowiak K, Radlińska O, Rybka A, Grabczak EM, Maskey-Warzęchowska M, et al. Validation of the Polish Version of the Chronic Cough Quality of Life Questionnaire (Leicester Cough Questionnaire). Adv Clin Exp Med. 25: 649–53. pmid:27629838
  16. 16. Kwon J-W, Moon J-Y, Kim S-HS-HS-H, Song W-J, Kim M-H, Kang M-G, et al. Reliability and Validity of a Korean Version of the Leicester Cough Questionnaire. Allergy Asthma Immunol Res. 2015;7: 230. pmid:25749761
  17. 17. Han J-M, Jung I-C, Kang W, Kim S-S, Yeo Y, Park Y-C. Reliability and validity of Leicester Cough Questionnaire Korean version. Chron Respir Dis. 2014;11: 147–152. pmid:24906688
  18. 18. Felisbino MB, Steidle LJM, Gonçalves-Tavares M, Pizzichini MMM, Pizzichini E. Leicester Cough Questionnaire: translation to Portuguese and cross-cultural adaptation for use in Brazil. J Bras Pneumol. 40: 213–21. pmid:25029643
  19. 19. Gao Y-H, Guan W-J, Xu G, Gao Y-H, Lin Z-YZ-M, Tang Y, et al. Validation of the Mandarin Chinese version of the Leicester Cough Questionnaire in bronchiectasis. Int J Tuberc Lung Dis. 2014;18: 1431–1437. pmid:25517807
  20. 20. Muñoz G, Buxó M, de Gracia J, Olveira C, Martinez-Garcia MA, Giron R, et al. Validation of a Spanish version of the Leicester Cough Questionnaire in non-cystic fibrosis bronchiectasis. Chron Respir Dis. 2016;13: 128–136. pmid:26902541
  21. 21. Reychler G, Schinckus M, Fremault A, Liistro G, Pieters T. Validation of the French version of the Leicester Cough Questionnaire in chronic obstructive pulmonary disease. Chron Respir Dis. 2015;12: 313–319. pmid:26346891
  22. 22. Pornsuriyasak P, Kawamatawong T, Rattanasiri S, Tantrakul V, Pongmesa T, Birring SS, et al. Validity and Reliability of Thai Version of the Leicester Cough Questionnaire in Chronic Cough. Asian Pacific J Allergy Immunol. 2016;34: 212–216. pmid:27001649
  23. 23. Murray MP, Turnbull K, MacQuarrie S, Pentland JL, Hill AT. Validation of the Leicester Cough Questionnaire in non-cystic fibrosis bronchiectasis. Eur Respir J. 2009;34: 125–131. pmid:19196812
  24. 24. Berkhof FF, Boom LN, ten Hertog NE, Uil SM, Kerstjens HA, Wk Van Den Berg J, et al. The validity and precision of the leicester cough questionnaire in COPD patients with chronic cough. Health Qual Life Outcomes. 2012;10: 4. pmid:22230731
  25. 25. Del Corral T, Percegona J, Lopez N, Valiente A, Garriga M, Seborga M, et al. Validity of a Spanish Version of the Leicester Cough Questionnaire in Children With Cystic Fibrosis. Arch Bronconeumol. Elsevier; 2016;52: 63–69. pmid:26163742
  26. 26. Yousaf N, Lee KK, Jayaraman B, Pavord ID, Birring SS. The assessment of quality of life in acute cough with the Leicester Cough Questionnaire (LCQ-acute). Cough. 2011;7: 4. pmid:21767404
  27. 27. Ogawa H, Fujimura M, Takeuchi Y, Makimura K. Clinical experience with low-dose itraconazole in chronic idiopathic cough. Cough. 2013;9: 1. pmid:23317373
  28. 28. Faruqi S, Molyneux ID, Fathi H, Wright C, Thompson R, Morice AH. Chronic cough and esomeprazole: A double-blind placebo-controlled parallel study. Respirology. Blackwell Publishing Asia; 2011;16: 1150–1156. pmid:21707852
  29. 29. Hodgson D, Anderson J, Reynolds C, Oborne J, Meakin G, Bailey H, et al. The Effects of Azithromycin in Treatment-Resistant Cough. Chest. 2016;149: 1052–1060. pmid:26836927
  30. 30. Morice AH, Menon MS, Mulrennan SA, Everett CF, Wright C, Jackson J, et al. Opiate Therapy in Chronic Cough. pmid:17122382
  31. 31. Acquadro C, Conway K, Hareendran A, Aaronson N. Literature Review of Methods to Translate Health-Related Quality of Life Questionnaires for Use in Multinational Clinical Trials. Value Heal. 2008;11: 509–521. pmid:18179659
  32. 32. Statement on sarcoidosis. Joint Statement of the American Thoracic Society (ATS), the European Respiratory Society (ERS) and the World Association of Sarcoidosis and Other Granulomatous Disorders (WASOG) adopted by the ATS Board of Directors and by the ER. Am J Respir Crit Care Med. American Thoracic SocietyNew York, NY; 1999;160: 736–55. pmid:10430755
  33. 33. Ware JE, Sherbourne CD. The MOS 36-Item Short-Form Health Survey (SF-26): I. Conceptual Framework and Item Selection. Med Care. 1992;30: 473–483. pmid:1593914
  34. 34. Borg GA. Psychophysical bases of perceived exertion. Medicine and science in sports and exercise. 1982. pp. 377–381. https://doi.org/10.1249/00005768-198205000-00012 pmid:7154893
    • 35. Aitken RC. Measurement of feelings using visual analogue scales. Proc R Soc Med. 1969;62: 989–993. pmid:4899510
    • 36. Varni JW, Seid M, Rode CA. The PedsQL: measurement model for the pediatric quality of life inventory. Med Care. 1999;37: 126–39. pmid:10024117
    • 37. Lin CY, Luh WM, Cheng CP, Yang AL, Su CT, Ma HI. Measurement equivalence across child self-reports and parent-proxy reports in the Chinese version of the pediatric quality of life inventory version 4.0. Child Psychiatry Hum Dev. 2013;44: 583–590. pmid:23242709
    • 38. McHorney CA, Tarlov AR. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res. 1995;4: 293–307. pmid:7550178
    • 39. Fisseni H-J. Lehrbuch der psychologischen Diagnostik: mit Hinweisen zur Intervention. Hogrefe; 2004.
      • 40. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model A Multidiscip J. Taylor & Francis Group; 1999;6: 1–55.
      • 41. Tucker LR, Lewis C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika. Springer-Verlag; 1973;38: 1–10.
      • 42. Farin E, Ullrich A, Hauer J. Participation and social functioning in patients with fibromyalgia: development and testing of a new questionnaire. Health Qual Life Outcomes. BioMed Central; 2013;11: 135. pmid:23914807
      • 43. Kline R. The principles and practice of structural equation modeling. 2011.
        • 44. Coster WJ, Haley SM, Andres PL, Ludlow LH, Bond TLY, Ni P. Refining the Conceptual Basis for Rehabilitation Outcome Measurement. Med Care. 2004;42: I–62. pmid:14707756
        • 45. Reeve BB, Hays RD, Bjorner JB, Cook KF, Crane PK, Teresi JA, et al. Psychometric evaluation and calibration of health-related quality of life item banks: plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Med Care. 2007;45: S22–31. pmid:17443115
        • 46. Conrad KJ, Smith EV. International Conference on Objective Measurement: Applications of Rasch Analysis in Health Care. Med Care. 2004;42: I–1. pmid:14707750
        • 47. Wright B, Linacre J. Reasonable mean-square fit values. Rasch Meas Trans. 1994;8:3: 370.
        • 48. Chang C-C, Su J-A, Tsai C-S, Yen C-F, Liu J-H, Lin C-Y. Rasch analysis suggested three unidimensional domains for Affiliate Stigma Scale: additional psychometric evaluation. J Clin Epidemiol. 2015;68: 674–83. pmid:25748074
        • 49. Christensen KS, Oernboel E, Zatzick D, Russo J. Screening for depression: Rasch analysis of the structural validity of the PHQ-9 in acutely injured trauma survivors. J Psychosom Res. 2017;97: 18–22. pmid:28606494
        • 50. Lim L, Seubsman S, Sleigh A. Thai SF-36 health survey: tests of data quality, scaling assumptions, reliability and validity in healthy men and women. Health Qual Life Outcomes. BioMed Central; 2008;6: 52. pmid:18634552
        • 51. Terwee CB, Bot SDM, de Boer MR, der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60: 34–42. pmid:17161752
        • 52. Chang C-C, Su J-A, Lin C-Y. Using the Affiliate Stigma Scale with caregivers of people with dementia: psychometric evaluation. Alzheimers Res Ther. 2016;8: 45. pmid:27784332
        • 53. Chen FF. Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Struct Equ Model A Multidiscip J. Taylor & Francis Group; 2007;14: 464–504.
        • 54. Wu T-H, Chang C-C, Chen C-Y, Wang J-D, Lin C-Y. Further psychometric evaluation of the self-stigma scale-short: measurement invariance across mental illness and gender. Maulik PK, editor. PLoS One. 2015;10: e0117592. pmid:25659115
        • 55. Sönnerfors P, Faager G, Einarsson U. Translation of the Leicester Cough Questionnaire into Swedish, and validity and reliability in chronic obstructive pulmonary disease. Disability and Rehabilitation. 20 Jul 2017: 1–9. pmid:28728439
        • 56. Chang C-C, Lin C-Y, Gronholm PC, Wu T-H. Cross-Validation of Two Commonly Used Self-Stigma Measures, Taiwan Versions of the Internalized Stigma Mental Illness Scale and Self-Stigma Scale-Short, for People With Mental Illness. Assessment. 2018;25: 777–792. pmid:27385391