Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Development and validation of the African Women Awareness of CANcer (AWACAN) tool for breast and cervical cancer

  • J. Moodley ,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    Jennifer.moodley@uct.ac.za

    Affiliations Women’s Health Research Unit, School of Public Health and Family Medicine, Faculty of Health Sciences, University of Cape Town; Observatory, Cape Town, South Africa, Cancer Research Initiative, Faculty of Health Sciences, University of Cape Town; Observatory, Cape Town, South Africa, SAMRC Gynaecology Cancer Research Centre, Faculty of Health Sciences, University of Cape Town, Observatory, Cape Town, South Africa

  • S. E. Scott,

    Roles Conceptualization, Methodology, Validation, Writing – review & editing

    Affiliation Centre for Oral, Clinical and Translational Sciences, Faculty of Dentistry, Oral and Craniofacial Sciences, King’s College London, London, United Kingdom

  • A. D. Mwaka,

    Roles Conceptualization, Project administration, Supervision, Writing – review & editing

    Affiliation Department of Medicine, School of Medicine, College of Health Sciences, Makerere University, Kampala, Uganda

  • D. Constant,

    Roles Data curation, Formal analysis, Methodology, Validation, Writing – review & editing

    Affiliation Women’s Health Research Unit, School of Public Health and Family Medicine, Faculty of Health Sciences, University of Cape Town; Observatory, Cape Town, South Africa

  • J. N. Githaiga,

    Roles Investigation, Project administration, Writing – review & editing

    Affiliation Women’s Health Research Unit, School of Public Health and Family Medicine, Faculty of Health Sciences, University of Cape Town; Observatory, Cape Town, South Africa

  • T. S. Stewart,

    Roles Formal analysis, Investigation, Writing – review & editing

    Affiliation Department of Obstetrics & Gynaecology, Plymouth Hospitals NHS Trust, Derriford Hospital, Plymouth, Devon, United Kingdom

  • A. Payne,

    Roles Investigation, Writing – review & editing

    Affiliation Cancer Research Initiative, Faculty of Health Sciences, University of Cape Town; Observatory, Cape Town, South Africa

  • L. Cairncross,

    Roles Conceptualization, Investigation, Visualization, Writing – review & editing

    Affiliation Surgical Endocrine Oncology Unit, Division of General Surgery, Department of Surgery, University of Cape Town; Observatory, Cape Town, South Africa

  • N. I. M. Somdyala,

    Roles Conceptualization, Writing – review & editing

    Affiliation Eastern Cape Cancer Registry, South African Medical Research Council, Burden of Disease Research Unit, Tygerberg, South Africa

  • F. M. Walter

    Roles Conceptualization, Funding acquisition, Methodology, Validation, Writing – review & editing

    Affiliation The Primary Care Unit, Department of Public Health & Primary Care, University of Cambridge, Cambridge, United Kingdom

Development and validation of the African Women Awareness of CANcer (AWACAN) tool for breast and cervical cancer

  • J. Moodley, 
  • S. E. Scott, 
  • A. D. Mwaka, 
  • D. Constant, 
  • J. N. Githaiga, 
  • T. S. Stewart, 
  • A. Payne, 
  • L. Cairncross, 
  • N. I. M. Somdyala, 
  • F. M. Walter
PLOS
x

Abstract

Background

Measuring factors influencing time to presentation is important in developing and evaluating interventions to promote timely cancer diagnosis, yet there is a lack of validated, culturally relevant measurement tools. This study aimed to develop and validate the African Women Awareness of CANcer (AWACAN) tool to measure awareness of breast and cervical cancer in Sub-Saharan Africa (SSA).

Methods

Development of the AWACAN tool followed 4 steps: 1) Item generation based on existing measures and relevant literature. 2) Refinement of items via assessment of content and face validity using cancer experts’ ratings and think aloud interviews with community participants in Uganda and South Africa. 3) Administration of the tool to community participants, university staff and cancer experts for assessment of validity using test-retest reliability (using Intra-Class Correlation (ICC) and adjusted Kappa coefficients), construct validity (comparing expert and community participant responses using t-tests) and internal reliability (using the Kuder-Richarson (KR-20) coefficient). 4) Translation of the final AWACAN tool into isiXhosa and Acholi.

Results

ICC scores indicated good test-retest reliability (≥ 0.7) for all breast cancer knowledge domains and cervical cancer risk factor and lay belief domains. Experts had higher knowledge of breast cancer risk factors (p < 0.001), and cervical cancer risk factors (p = 0.003) and symptoms (p = 0.001) than community participants, but similar knowledge of breast cancer symptoms (p = 0.066). Internal reliability for breast cancer risk factors, lay beliefs and symptom and cervical cancer symptom subscales was good with KR-20 values > 0.7, and lower (0.6) for the cervical cancer risk subscale.

Conclusion

The final AWACAN tool includes items on socio-demographic details; breast and cervical cancer symptom awareness, risk factor awareness, lay beliefs, anticipated help-seeking behaviour; and barriers to seeking care. The tools showed evidence of content, face, construct and internal validity and test-retrest reliability and are available for use in SSA in three languages.

Introduction

Breast and cervical cancer are the leading causes of cancer morbidity and mortality in women in Sub-Saharan Africa (SSA). Breast cancer is the most commonly diagnosed cancer among women in SSA, whilst cervical cancer remains the leading cause of cancer death [1]. Most SSA countries do not have cervical or breast cancer screening programs and the majority of cancers (85–90%) present symptomatically and at an advanced stage [2].

Studies have shown that for symptomatic breast cancer, a shorter time between recognition of symptoms by women and first medical consultation is associated with early stage disease, and better breast cancer survival [36]. Further, a substantial proportion of advanced stage diagnosis of poorly differentiated breast cancer cases could be avoided if patients had presented within one month of detecting symptoms [4]. For both breast and cervical cancer there are often subtle but important symptoms in early stage disease, yet women may misinterpret these symptoms or wait until symptoms (and disease) progress before they seek medical attention [710]. Research outside SSA has indicated that cancer symptom awareness among the general population can be low [1112], and that interventions to increase awareness lead to better outcomes. For example, in Malaysia, raising public awareness of symptoms has been associated with earler diagnosis of cervical cancer [13].

For people with potential symptoms of cancer, the pathway to cancer diagnosis is complex and influenced by many factors such as symptom and risk awareness, beliefs and barriers to accessing care [9,10,1418]. Measuring these factors is important in developing and evaluating interventions to promote timely cancer diagnosis. A recent scoping study highlighted the need for local research arising from low-and middle-income countries to adequately address breast and cervical cancer prevention and control [19].

Although a few studies have reported on breast and cervical cancer symptom awareness, risk perception and help-seeking behavior in African settings [9,10,20,21], measurement and comparison is hampered by the lack of validated, culturally relevant measurement tools. The Cancer Awareness Measure (CAM) and the Awareness and Beliefs about Cancer (ABC) tools, developed and validated in the UK to reliably assess cancer awareness in the general public, are questionnaires that include generic and cancer site specific modules [2226]. The CAM and ABC tools could be of value beyond the UK, but as they were developed in a very different cultural setting they need to be adapted and validated for use in SSA. A Kenyan research team adapted the Breast Cancer Awareness Measurement (BCAM) for local use and reported on validity testing of two of the tool domains (symptom awareness and barriers to screening) [27]. The team reported good content validity and internal reliability for the two domains, demonstrating that the BCAM could be adapted for use in African populations, but they also recommended further validation. The aim of the current study was to develop and validate an African Women’s Awareness of CANcer (AWACAN) tool to measure awareness of symptoms and risk factor for breast and cervical cancer, lay beliefs, confidence in appraising potential symptoms, help-seeking behavior and barriers to health care.

Methods

The four step processes of 1) generating tool items, 2) refining and 3) validating the English version of the AWACAN tool and, 4) developing local language versions of the tool are described below. The outcomes of Step 3 are presented in the results section. Ethics approval for the study was obtained from University of Cape Town, Faculty of Health Sciences Human Research Ethics Committee (HREC 544/2016), the Lacor Hospital Institutional Research Ethics Committee (LHIREC 027/11/2016) and the Ugandan National Council of Science and Technology (UNCST 194/212/01). Written informed consent was obtained from all participants. Permission to access health facilities was obtained from all relevant local health authorities. Permission to conduct interviews with non-medical university staff was obtained from the institutional human resource department.

Step 1: Generating items for the AWACAN tool

Items to assess breast and cervical cancer symptom and risk factor awareness and help-seeking behavior were generated by reviewing the UK (BCAM) and Cervical Cancer Awareness Measurement (CCAM) tools, the ABC tool, and studies conducted in Africa that used these or other tools to measure constructs of interest to our study [10, 2527]. Items relating to overall cancer awareness (not specific to breast or cervical cancer) and awareness of screening programs were excluded as this was not the focus on our study. The multi-disciplinary research team reviewed the list of items, making changes so that the terminology would be applicable to the African setting. A first version of the AWACAN tool was drafted and consisted of a total of 131 items: 13 socio-demographic; 57 breast cancer; 42 cervical cancer and; 19 barriers to seeking health care questions. The list of variables included; having heard of or knowing someone with breast or cervical cancer; knowledge of age-related risk; knowledge of risk factors and symptoms of breast and cervical cancer (evidence-based); and risk lay beliefs such as exposure to an unhygienic environment, placing objects in undergarments and witchcraft. Based on experiences with the use of BCAM in Kenya [27], we chose to commission images of breast cancer signs on dark skinned women, developed by a graphic designer in consultation with the breast cancer surgeon on the team (LC). Items also assessed confidence in detecting breast or cervical cancer symptoms. Help-seeking behavior variables assessed whether participants would ignore symptoms, try self-medication, inform a friend/relative, visit a traditional healer and visit a medical facility. Anticipated time to presentation to medical facilities and traditional healers was measured on a scale from immediately to more than 1 year. Barriers to seeking care were measured in terms of emotional, practical and service related barriers. The AWACAN tool was designed to be delivered via a structured interview rather than self-completed questionnaire.

Step 2: Refinement of items for the AWACAN tool

To assess content validity.

A group of cancer experts based in SSA (n = 48) were invited to complete an anonymous online survey and score the AWACAN tool items in terms of clarity and relevance [(1(poor) - 4 (excellent)], provide reasons for any item scoring < 3, and identify missing items. The experts included breast or cervical cancer health professionals, epidemiologists and public health researchers and were identified from peer-reviewed literature, websites of relevant academic and research organizations and through contacts of research team members. A content validity index [(CVI) number of raters giving a score of ≥3/total number of raters] was calculated for each tool item [28]. Any item with a CVI >78% was regarded as having an adequate CVI as recommended by Lynn et al. [28]. In total 25 experts completed the online survey.

To assess face validity.

Cognitive interviews using think-aloud methodology [2930] were conducted with English-speaking women aged 18 years and older to assess interpretation and understanding of the tool items. Participants, excluding women with a history of breast or cervical cancer, were recruited from primary care clinics in urban primary health care clinics in South Africa (n = 10) and Uganda (n = 10) and asked to think aloud as they responded to the structured interview. Interviews were transcribed verbatim and analysed to identify areas of ambiguity and items causing distress.

Findings from both the cancer expert review and the cognitive interviews were reviewed and tool items revised where necessary. This resulted in: items being deleted; questions being reworded/rephrased for clarity; definitions being added for poorly understood terms and; a revision of response options for some questions. Items on age-related risk factors (e.g. Do you think that a woman younger than you is more likely to get breast cancer?) were deleted as they were poorly understood by participants and all had a low CVI. An item on participant’s religion was deleted as it had a low CVI (0.56) with cancer experts noting that it could be viewed as being judgemental. Five questions were identified as being redundant as they were covered elsewhere in the questionnaire and were removed. Explanations were added for the terms “hormone replacement therapy” and “menopause” as these were poorly understood by women. All questions with Likert response options had a low CVI (< 78%) and were poorly understood by women during the cognitive interviews. Options for these questions were revised. For example, the question “How confident are you that you would notice a change in your breast?” with response options a. very confident b. fairly confident c. slightly confident and d. not confident at all was changed to “Are you confident that you would notice a change in your breast?” with response options a. yes b. no c. not sure.

The refinement process resulted in a second version of the AWACAN tool with a total of 123 items: 12 socio-demographic questions; 53 breast cancer symptom,risk factor, confidence and help-seeking questions; 39 cervical cancer symptom, risk factor, confidence and help-seeking questions and 19 items on barriers to seeking care.

Step 3: Validation of the AWACAN tool

Participants and procedure.

Three groups of participants completed the second version of the AWACAN tool:

  1. Community participants: Women aged ≥ 18 years and able to speak and understand English were recruited from primary care clinics at the sites used for the cognitive interviews described above. English proficiency was assessed by a trained interviewer during the process of providing study information and obtaining informed consent. Participants that were unable to understand and speak English were excluded. Women were stratified by age during recruitment to ensure representation by older (≥ 50 years) and younger (< 50 years) participants. Trained field workers administered the tool to participants.
  2. Cancer experts: Experts who participated in the content validaty exercise (Step 2A) were invited to complete an on-line version of the tool.
  3. A convenience sample of non-medical university staff: aged 18 to 65 years were recruited from the University of Cape Town. A trained interviewer administered the tool on two occasions, two weeks apart. Participants were stratified by age (≥ 50 years and < 50 years).

Data management.

All data was entered into Qualtrics and analysed using STATA (Version 13.0). Scores for risk factor knowledge and symptom awareness were calculated with each correct answer to the evidence-based questions in the closed/prompted sections scoring 1 point. Lay beliefsthat were correctly identified as not being a risk factor scored 1 point.

The revised 123-item tool was assessed in terms of indicators of test-retest reliability, construct validity and internal reliability.

Test-rest reliability analysis.

For categorical variables related to awareness (having heard of or knowing someone with relevant cancer), help-seeking behaviour and confidence test-retest reliability was calculated using the Brennan and Prediger prevalence-adjusted and bias-adjusted Kappa. Adjusted Kappas were calculated as the unadjusted Cohen Kappa is prevalence dependant and misleading when ratings fall into a single category [31,32]. We present both adjusted Kappa and Cohen’s Kappa values, as adjusted Kappa presented alone can be difficult to interpret. Kappa coefficients were interpreted as follows: <0.00 as poor; 0.00–0.20 as slight; 0.21–0.40 as fair; 0.41–0.60 as moderate; 0.61–0.80 as substantial and 0.81–1.0 as almost perfect agreement [33].

For knowledge domains, test-retest reliability was assessed by comparing the mean test and retest scores of the non-medical staff, using the intra-class correlation coefficient (ICC) with values below 0.5 indicating poor reliability, between 0.5 and 0.75 moderate reliability, between 0.76 and 0.9 good reliability, and above 0.9 excellent reliability [34].

Construct validity analysis.

Construct validity was assessed by comparing knowledge scores between the cancer experts and community participant group using t-tests. We hypothesized that if the tool had construct validity then cancer experts would have significantly (p<0.05) higher awareness compared to community respondents.

Internal reliability analysis.

Internal reliability for the risk factor and symptom knowledge constructs were assessed using the Kuder-Richarson (KR-20) coefficient of reliability and the item-to-total correlation coefficients. A KR-20 of > 0.7 was considered to indicate good internal reliability [35,36]. For the item-to-total correlation, a value greater than 0.2 was an indicator that an item was related to the overall scale [22,37].

Sample size.

Typically, studies measuring internal reliability are based on the assumption that the number of respondents should exceed the number of items by 2 to 20 subjects per item, with a minimum of 100 subjects to ensure stability of the variance-covariance matrix [38]. Our sample size was based on an initial anticipated 60-item per cancer tool. Applying a 3:1 subject to item ratio we aimed to recruit a total of 180 to ensure a reasonably precise estimate the KR-20.

Step 4: Development of the local language versions of the tool

The English version of the final AWACAN tool was translated into isiXhosa (the 2nd commonest of 11 official languages in SA and Acholi (spoken in Northern Uganda and parts of Kenya and Tanzania) by Acholi and isiXhosa native speakers, and back translated into English to ensure comparability [39,40]. Forward and backward translations were also undertaken by a university-based language translation unit in South Africa and by health educators and senior clergy experienced in translating religious and government documents from English into Luo/Acholi. To ensure conceptual and cultural equivalence, cancer experts (SA = 4, Uganda = 4) fluent in both English and the local language scored tool items from 1(poor) to 4(excellent) on equivalence of meaning comparing the English and locally translated version. For items that were scored as 3 or less, experts were asked to suggest changes. Cognitive interviews using think-aloud methodology were carried out with local-language speaking community participants using the IsiXhosa version (SA, n = 8) and the Luo/Acholi version (Uganda, n = 10) to assess whether questions were understood as intended. Participants were recruited from primary health care clinics at urban and rural sites in South Africa and Uganda. Interviews were conducted by trained local interviewers conversant in the local language.

This process resulted in minor changes; these included correction of spelling errors, changes in phrasing to language used more commonly in communities, and inclusion of words that had been inadvertently omitted in the translation.

Results

In total there were 139 community (SA n = 72, Uganda n = 67), 23 non-medical staff and 20 cancer expert participants who completed the validation studies (Step 3). Table 1 outlines the socio-demographic characteristics of the participant groups.

Test-retest reliability

There was no loss-to follow up between the first and second round of interviews. The percentage of agreement for responses to the socio-demographic questions was high (> 96% for all questions and total agreement for 8 of the 11 socio-demographic variables). Kappa scores for the socio-demographic questions ranged between 0.83 and 1.00.

Table 2 shows the agreement, the Brennan and Prediger prevalence-adjusted and bias-adjusted kappa and the unadjusted kappa scores in brackets for items relating to awareness, help-seeking behavior and confidence. For breast cancer, the adjusted kappa co-efficient ranged from 0.57 to 1.0 with one item (‘self-medicate’) showing moderate agreement and other items indicating substantial or almost perfect agreement. For cervical cancer, the adusted kappa coeeficients ranged from 0.65–1.0 i.e. all showed substantial or higher agreement. Unadjusted kappa co-efficient (shown in brackets) ranged from -0.06 to 1.0 for both cancers.

thumbnail
Table 2. Test-retest reliability of awareness, help-seeking behavior and confidence.

https://doi.org/10.1371/journal.pone.0220545.t002

Test-retest reliability was moderate for knowledge of known risk factors, good for symptoms and excellent for lay beliefs of breast cancer (Table 3). For cervical cancer, test-retest reliability was moderate for known risk factors, lay beliefs and the symptom domain.

Construct validity

A high proportion of community participants had heard of breast and cervical cancer (90% and 84% respectively) and there were no statistically significant differences between experts and community members for these items (1-sided Fischer’s exact test p value = 0.184 and 0.222 respectively).

For breast cancer, community participant and expert scores were significantly different for knowledge of evidence-based risk factors and risk lay beliefs but similar for breast cancer symptoms (Table 4). There was clear discrimination between the community participants and cancer experts’ knowledge of evidence-based risk factors and symptoms of cervical cancer. Knowledge did not differ significantly for the 1 cervical cancer risk lay belief (p = 0.444).

Internal reliability

The internal reliability for the breast cancer knowledge questions was good with KR-20 values > 0.7 for the known risk factors, lay belief and symptom subscales (Table 5). For cervical cancer the KR-20 for the known risk factors subscale was lower (0.60). Cervical cancer risk factors items with a very low item-to-total correlation were: HPV (0.18), using birth control/family planning pills for more than 5 years (0.13), not going for regular screening (0.09). Internal reliability for the cervical cancer symptom questions was good (0.80).

Final AWACAN tool

Following assessment of reliability and validity, further adjustments to phrasing of some items were made to improve clarity. The number of questions related to barriers to seeking care was reduced (7 questions removed) as interviewers noted that participants found that this section was too long. In addition the wording of questions was changed to better indicate that these were barriers personally experienced by the respondent. Responses to open questions on risk factors and symptoms were reviewed to identify additional lay beliefs.

The final version of the AWACAN tool has a total of 115 items:

  1. 12 socio-demographic questions;
  2. 50 breast cancer symptom, risk factor awareness, confidence and help-seeking measures
    • 2 introductory questions
    • 1 open question on risk factors
    • 13 closed prompted evidence-based risk factor questions
    • 6 closed prompted questions on lay beliefs related to risk (can serve as distractor items)
    • 1 open question on symptom awareness
    • 15 closed prompted questions on symptom awareness items. Images of symptoms as they would appear on dark-skinned women were added for 3 items: change in the position of the nipple, pilling in of the nipple, and dimpling of the breast skin
    • 1 closed prompted question on symptom lay belief (can serve as distractor item)
    • 7 items related to help-seeking behaviour
    • 4 items on confidence in relation to breast changes
  3. 41 cervical cancer symptom, risk factor awareness, confidence and help-seeking measures
    • 2 introductory questions
    • 1 open question on risk factors
    • 11 closed prompted evidence-based risk factor questions
    • 4 closed prompted questions on lay beliefs related to risk (can serve as distractor items)
    • 1 open question on symptom awareness
    • 11 closed prompted questions on symptom awareness items
    • 1 closed prompted question on symptom lay belief (can serve as distractor item)
    • 7 items related to help-seeking behaviour
    • 3 items on confidence in relation to detecting cervical cancer signs/symptom
  4. 12 items on barriers to seeking care for breast and cervical cancer

See S1 Appendix The AWACAN tool for breast and cervical cancer English version and S2 Appendix Images of breast cancer changes. The English, isiXhosa and Acholi versions of the tool as well as the breast images are available at www.awacan.online

Discussion

To our knowledge this is the first validated tool measuring breast and cervical cancer symptom and risk factor awareness, lay beliefs, confidence in appraising potential symptoms, help seeking behaviour and barriers to care in SSA populations. The AWACAN tool follows a similar format to the BCAM and CCAM [25,26]. Knowledge of risk factors and symptoms are first assessed with open-ended questions followed by a prompted checklist of known factors. Participants are not permitted to revise open-ended responses. This sequence of questioning allows respondents an opportunity to describe their own views without the possibility of guessing or being limited by the pre-existing options of the prompted questions that follow. Although responses to open-ended questions are more time-consuming to analyze compared to prompted questions, they can provide insights into terms and phrases commonly used to describe risk and symptoms which could assist in providing culturally relevant and easily understood language for interventions. Open-ended responses can also assist in identifying locally relevant risk and symptom lay beliefs.

Our AWACAN tool performed well in terms of test-retest reliability indicating that the questions are stable over time. Most socio-demographic, help-seeking behaviour and confidence items achieving substantial or higher adjusted kappa coefficients and all knowledge sub-scales showing moderate or higher reliability as measured by the ICC.

The AWACAN tool discriminated well between the expert and community level knowledge of breast cancer risk factors and risk lay beliefs. However, breast symptom knowledge was similar between these two groups. This could be a result of greater public awareness of breast symptoms, which is a focus of many breast awareness campaigns. Knowledge of cervical cancer items risk factors and symptoms was significantly higher in cancer experts compared to community participants, establishing construct validity for these subscales. At the stage of psychometric testing we only had one cervical cancer risk lay belief and although experts were better able to identify this lay belief the difference was not statistically different. Using responses from the open-ended questions we were able to identify additional lay belief items.

Internal reliability was good for our breast cancer questions, with all knowledge domains achieving a KR-20 above the recommend cut-off value of 0.7. Internal reliability was also high (KR-20 = 0.8) for the cervical cancer symptom domain, but lower (KR-20 = 0.6) for the subsection on risk factors. The three risk factor items contributing to this low internal reliability (HPV, use of birth control/family planning pills, not going for regular screening) were retained in the final tool on grounds of content validity.

After establishing good validity for the English version of the tool, it was translated into two 2 local languages (isiXhosa and Acholi), taking into account conceptual and cultural equivalence. In addition to these translations, there are some other important differences between our validated AWACAN tool and the BCAM and CCAM tools. Our tool includes additional prompted items on symptom and risk lay beliefs that were identified from the literature [27], and in responses to the open questions administered during the AWACAN development and validation process. These questions provide insights into lay beliefs that may need to be addressed when developing SSA-relevant and targeted interventions to improve timely diagnosis in these populations. In addition, the lay belief questions which are interspersed between known risk factors and symptoms serve as distractor items. For effectiveness, distractor items should represent incorrect responses that study participants could be expected to produce and avoid obviously implausible responses [41]. We were able to identify a number of breast and cervical cancer risk lay beliefs, but only one breast and one cervical cancer symptom lay belief. When the AWACAN tool is used in future studies, evaluation of open responses could assist in identifying additional locally relevant symptom distractor items.

Based on the recommendation of Wachira et al [27], we developed images for 3 breast cancer symptoms on dark-skinned women to be used with the tool. We believe that this is an important addition to cancer awareness measurement tools in our context. Further, these images can be used in awareness raising interventions. The AWACAN tool also includes simple explanations for terms that were not well understood by participants in our setting (e.g. menopause). Compared to the CAM tools our final tool does not include age-related risk factors as these were poorly understood by community participants and also received a low CVI score from experts.

The BCAM and CCAM tools make use of Likert scales, which call for a graded response to a series of statements about risk and confidence. Likert scales are widely used in surveys, however studies have reported challenges such as difficulty in understanding graded response options, skipping questions or bias toward either the midpoint or extreme options [42,43]. During cognitive testing we noted that participants in both SA and Uganda had difficulty understanding the Likert-type scales used in the CAM tools. Questions were thus modified in our tool to allow for simpler response options.

Understanding women’s help-seeking behaviour and potential barriers to care are critical to informing efforts to improve timely diagnosis of these cancers. The ABC and CAM tools includes measures of barriers to care and help-seeking behaviour relevant in high-income setting [23,25,26]. We included additional questions to reflect the different realities in the SSA context. For example, traditional healers are often consulted for health-related issues in SSA [44] and are included in our measures. We reduced the number of questions on barriers to seeking care in the final tool and made substantial changes to the wording of the remaining questions. Validity of this domain of our questionnaire will be further evaluated in future use of the tool and attention paid to context-specific variations.

Over the past few decades, there has been an increasing recognition that a holistic and comprehensive approach to women’s health is central to sustainable development [45,46]. We developed the AWACAN tool so that the two most common cancer in females in SSA can be addressed in one study to maximise data collection from women. However the tool can also be used for either breast or cervical cancer assessments alone.

A limitation of our study was the difference in mode of delivery to the cancer experts (online) versus other participants (face-to-face) during the validation process. We designed the online tool so that experts were unable to return to previous pages to change responses. However, we recognize that experts could have searched the internet or consulted elsewhere before completing the tool online. We used Classical Test Theory to assess reliability and validity of the AWACAN tool. An alternative would be to use Item Response Theory [47,48]. However this would have required an extremely large sample size given the number of items in the questionnaire. Classical Test Theory was used in the development of the CAM and is adequate for this developmental phase, especially in a context with limited resources. The isiXhosa and Acholi versions of the AWACAN tool have recently being used in a cross-sectional study and further psychometric testing with these local language versions of the tool are being undertaken. In addition we intend to administer and assess validity of the AWACAN tool in other SSA countries. Important and interesting differences are likely to be identified with this broader administration.

We have demonstrated that the breast and cervical AWACAN tool has evidence of reliability and validity and is ready to be used as a measure of risk factor and symptom awareness, lay beliefs, help seeking behavior and barriers to care for the two leading causes of cancer morbidity among women in SSA.

Supporting information

S1 Appendix. The AWACAN tool for breast and cervical cancer English version.

https://doi.org/10.1371/journal.pone.0220545.s001

(PDF)

Acknowledgments

The authors thank the participants for sharing their experiences and participating in the validation processes; the providers and managers of the primary health care clinics and our students for support in the data collection process and the University of Cape Town human resources department for facilitating access to non-medical staff. This research is linked to the CanTest Collaborative, which is funded by Cancer Research UK [C8640/A23385], of which Fiona M Walter is Director.

References

  1. 1. Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global Cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68(6):394–424 Full text available at: pmid:30207593
  2. 2. Sankaranarayanan R, Boffetta P. Research on cancer prevention, detection and management in low-and medium-income countries. Ann Oncol. 2010 Mar 15;21(10):1935–43. pmid:20231304
  3. 3. Neal RD, Tharmanathan P, France B, Din NU, Cotton S, Fallon-Ferguson J et al. Is increased time to diagnosis and treatment in symptomatic cancer associated with poorer outcomes? Systematic review. Brit J Cancer. 2015 Mar 3;112(s1):S92.
  4. 4. Arndt V, Stürmer T, Stegmaier C, Ziegler H, Dhom G, Brenner H. Patient delay and stage of diagnosis among breast cancer patients in Germany–a population based study. Brit J Cancer. 2002 Apr 2;86(7):1034. pmid:11953844
  5. 5. Richards MA, Westcombe AM, Love SB, Littlejohns P, Ramirez AJ. Influence of delay on survival in patients with breast cancer: a systematic review. The Lancet. 1999 Apr 3;353(9159):1119–26.
  6. 6. Sainsbury JR, Johnston C, Haward B. Effect on survival of delays in referral of patients with breast-cancer symptoms: a retrospective analysis. The Lancet. 1999 Apr 3;353(9159):1132–5.
  7. 7. Macleod U, Mitchell ED, Burgess C, Macdonald S, Ramirez AJ. Risk factors for delayed presentation and referral of symptomatic cancer: evidence for common cancers. Brit J Cancer. 2009 Dec 3;101(S2):S92.
  8. 8. Gyenwali D, Pariyar J, Onta SR. Factors associated with late diagnosis of cervical cancer in Nepal. Asian Pac J Cancer P 2013;14(7):4373–4377.
  9. 9. Moodley J, Cairncross L, Naiker T, Momberg M. Understanding pathways to breast cancer diagnosis among women in the Western Cape Province, South Africa: a qualitative study. BMJ open. 2016 Jan 1;6(1):e009905. pmid:26729392
  10. 10. Moodley J, Cairncross L, Naiker T, Constant D. From symptom discovery to treatment-women's pathways to breast cancer care: a cross-sectional study. BMC cancer. 2018 Dec;18(1):312. pmid:29562894
  11. 11. Robb K, Stubbings S, Ramirez A, Macleod U, Austoker J, Waller J et al. Public awareness of cancer in Britain: a population-based survey of adults. Brit J Cancer. 2009 Dec 3;101(S2).
  12. 12. Simon AE, Waller J, Robb K, Wardle J. Patient delay in presentation of possible cancer symptoms: the contribution of knowledge and attitudes in a population sample from the United Kingdom. Cancer Epidemiol Biomarkers Prev 2010 Sep;19(9):2272–2277. pmid:20660602
  13. 13. Devi BC, Tang TS, Corbex M. Reducing by half the percentage of late-stage presentation for breast and cervix cancer over 4 years: a pilot study of clinical downstaging in Sarawak, Malaysia. Ann Oncol. 2007 Apr 13;18(7):1172–6. pmid:17434897
  14. 14. Ramirez AJ, Westcombe AM, Burgess CC, Sutton S, Littlejohns P, Richards MA. Factors predicting delayed presentation of symptomatic breast cancer: a systematic review. The Lancet. 1999 Apr 3;353(9159):1127–31.
  15. 15. Jones CE, Maben J, Jack RH, Davies EA, Forbes LJ, Lucas G et al. A systematic review of barriers to early presentation and diagnosis with breast cancer among black women. BMJ open. 2014 Feb 1;4(2).
  16. 16. Norsa'adah B, Rampal KG, Rahmah MA, Naing NN, Biswal BM. Diagnosis delay of breast cancer and its associated factors in Malaysian women. BMC cancer. 2011 Dec;11(1):141.
  17. 17. Mwaka AD, Okello ES, Wabinga H, Walter FM. Symptomatic presentation with cervical cancer in Uganda: a qualitative study assessing the pathways to diagnosis in a low-income country. BMC women's health. 2015 Dec;15(1):15.
  18. 18. Unger-Saldaña K. Challenges to the early diagnosis and treatment of breast cancer in developing countries. World J Clinic Oncol. 2014 Aug 10;5(3):465.
  19. 19. Demment MM, Peters K, Dykens JA, Dozier A, Nawaz H, McIntosh S et al. Developing the evidence base to inform best practice: a scoping study of breast and cervical cancer reviews in low-and middle-income countries. PLoS One. 2015 Sep 1;10(9).
  20. 20. Ramathuba DU, Ratshirumbi CT, Mashamba TM. Knowledge, attitudes and practices toward breast cancer screening in a rural South African community. Curationis. 2015;38(1):1–8.
  21. 21. El-Shinawi M, Youssef A, Alsara M, Aly MK, Mostafa M, Yehia Aet al. Assessing the level of breast cancer awareness among recently diagnosed patients in Ain Shams University Hospital. The Breast. 2013 Dec 1;22(6):1210–4. pmid:24054904
  22. 22. Stubbings S, Robb K, Waller J, Ramirez A, Austoker J, Macleod U et al. Development of a measurement tool to assess public awareness of cancer. Brit J Cancer. 2009 Dec 3;101(S2).
  23. 23. Simon AE, Forbes LJ, Boniface D, Warburton F, Brain KE, Dessaix A et al. An international measure of awareness and beliefs about cancer: development and testing of the ABC. BMJ open. 2012 Jan 1;2(6).
  24. 24. Simon AE, Wardle J, Grimmett C, Power E, Corker E, Menon U et al. Ovarian and cervical cancer awareness: development of two validated measurement tools. J Fam Plann Reprod Health Care. 2011 Jul 1;38(3):167–74. pmid:21933805
  25. 25. UCL Health Behaviour Research Centre. Cervical Cancer Awareness Measure (CAM) [document on the internet]. Cancer Research UK, University College London, King’s College London, Oxford University; 2007–2008 [cited 2018 Nov 1]. Available from: https://www.cancerresearchuk.org/sites/default/files/health_professional_cervical_cancer_awareness_measure_toolkit_version_2.1_09.02.11.pdf
  26. 26. Breast Module of the Cancer Awareness Measure (Breast-CAM) [document on the internet]. Cancer Research UK, King’s College London and University College London; 2009 [cited 2018 Nov 1]. Available from: https://www.cancerresearchuk.org/sites/default/files/health_professional_breast_cam_toolkit_09.02.11.pdf
  27. 27. Wachira J, Busakhala A, Chite F, Naanyu V, Kisuya J, Otieno G et al. Refining a questionnaire to assess breast cancer knowledge and barriers to screening in Kenya: Psychometric assessment of the BCAM. BMC Health Serv Res. 2017 Dec;17(1):110. pmid:28158984
  28. 28. Lynn MR. Determination and quantification of content validity. Nurs Res. 1986 Nov.
  29. 29. Ericsson KA, Simon HA. Protocol analysis; Verbal reports as data (revised edition). Bradfordbooks.
  30. 30. Fox MC, Ericsson KA, Best R. Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods. Psychol Bull. 2011 Mar;137(2):316. pmid:21090887
  31. 31. Brennan RL, Prediger DJ. Coefficient kappa: Some uses, misuses, and alternatives. Educational and psychological measurement. 1981 Oct;41(3):687–99.
  32. 32. Byrt T., Bishop J., & Carlin J.B. (1993) Bias, Prevalence and Kappa. Journal of Clin Epidemiol 46(5):423–9)
  33. 33. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74. pmid:843571
  34. 34. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016; 15(2):155–63. pmid:27330520
  35. 35. Kuder GF, Richardson MW. The theory of the estimation of test reliability. Psychometrika. 1937 Sep 1;2(3):151–60.
  36. 36. Cortina JM. What is coefficient alpha? An examination of theory and applications. J Appl Psychol. 1993 Feb;78(1):98.
  37. 37. Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. Oxford University Press, USA; 2015.
  38. 38. Anthoine E, Moret L, Regnault A, Sébille V, Hardouin JB. Sample size used to validate a scale: a review of publications on newly-developed patient reported outcomes measures. Health Qual Life Out. 2014 Dec;12(1):2.
  39. 39. Statistics South Africa. Statistics South Africa: Consensus 2011. 2012; Available at: http://beta2.statssa.gov.za/. Accessed Aug, 2018.
  40. 40. Amone C. Contructivism, instrumentalism and the rise of Acholi ethnic identity in northern Uganda. African Identities. 2015 Apr 3;13(2):129–43.
  41. 41. Linn R, Gronlund N. Measurement and assessment in teaching. New Jersey: Prentice Hall. 2000
  42. 42. Lee JW, Jones PS, Mineyama Y, Zhang XE. Cultural differences in responses to a Likert scale. Res Nurs Heal. 2002 Aug;25(4):295–306.
  43. 43. T D'Alonzo K. Evaluation and revision of questionnaires for use among low-literacy immigrant Latinos. Revista latino-americana de enfermagem. 2011 Oct;19(5):1255–64. pmid:22030592
  44. 44. Fregene A, Newman LA. Breast cancer in sub‐Saharan Africa: how does it relate to breast cancer in African‐American women?. Cancer: Interdisciplinary International Journal of the American Cancer Society. 2005 Apr 15;103(8):1540–50.
  45. 45. Frenk J, Gomez-Dantes O, Langer A. A comprehensive approach to women's health: lessons from the Mexican health reform. BMC Womens Health 2012 Dec 10;12:42-6874-12-42.
  46. 46. Ginsburg O. Breast and cervical cancer control in low and middle-income countries: Human rights meet sound health policy. J Cancer Policy 2013;1(3):e35–e41.
  47. 47. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL et al. The COSMIN checklist for assessing the methodolog- ical quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19:539–549 pmid:20169472
  48. 48. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007 Jan 1;60(1):34–42. pmid:17161752