Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Comparative readability of information on different treatment options for breast cancer, based on WeChat public accounts

Abstract

Objective

To evaluate and compare the readability of information on different treatment options for breast cancer from WeChat public accounts, propose targeted improvement strategies based on the evaluation of the results of the various treatment options, and provide a reference for producers of WeChat public accounts from which to write highly readable information regarding breast cancer treatment options.

Methods

With “breast cancer” as keywords in April 2021, searches were implemented on Sogou WeChat website (https://weixin.sogou.com/) and WeChat mobile app. The selected WPAs were aimed to provided breast cancer health information, and the four latest articles of each WPA were included in the evaluation. Two independent observers assessed the readability of the articles through the Suitability Assessment of Materials (SAM) tool, and compared the readability of information on different treatment options, i.e., surgical treatment, medical treatment, complementary and alternative medicine (CAM), and comprehensive treatment.

Results

A total of 136 articles on different types of breast cancer treatments from 37 WeChat public accounts were included in the present study. The median SAM score was 50 (IQR, 41–60). In terms of treatment options, the readability of articles in the CAM category scored higher in the content 75 (IQR, 63–81), learning stimulation and motivation 75 (IQR, 50–83) and cultural appropriateness 75 (IQR, 75–75) categories than in the medical and surgical treatment categories (P < 0.05). Additionally, the readability of articles in the CAM category scored higher in the cultural appropriateness 75 (IQR, 75–75) category than those for comprehensive and medical treatment (P < 0.05).

Conclusions

The overall readability of information on breast cancer treatment options in WeChat public accounts was in the lower portion of the “adequate” level. The readability of articles on medical treatment options is poor, especially on clinical trial articles, which could be improved in terms of content, graphics, learning stimulation, and motivation to make them more suitable for public reading.

Introduction

According to Global Cancer Observatory (GLOBOCAN) 2020 data, breast cancer in women has surpassed lung cancer as the most common cancer in 2020, with 2,261,419 new cases, accounting for 11.7% of all cancers [1]. In China, breast cancer is an important cause of disability and death in women. According to 2020 data, the number of patients diagnosed with breast cancer in China was approximately 416,000, accounting for 9.1% of cancer cases nationwide, and having the fourth highest mortality rate among Chinese women [2]. In recent years, the quality of healthcare in China has been improving. However, the overall incidence and mortality rate of breast cancer are still increasing, leading to a focus on the prevention and control of malignant tumors in China.

For patients with breast cancer, quality care should include supportive measures, such as recommending quality sources of online health education information, to help them cope with their diagnosis [3]. The results of a study of patients with breast cancer in Italy showed that there is a high demand for online health education information, specifically in regards to treatment options [4]. The primary treatment options for breast cancer include surgery, medical treatment, complementary and alternative medicine (CAM), and comprehensive treatment. Medical treatment includes chemotherapy, radiotherapy, endocrine therapy, targeted therapy, and various clinical trials (chemotherapy and endocrine therapy) [5]. CAM refers to a group of medical practices and products that are not considered to be conventional medicine or standard treatments, with “complementary therapies” used in conjunction with conventional treatments and “alternative therapies” to replace them [6]. Comprehensive treatment involves the use of two or more surgical treatments, medical treatment, and/or CAM, i.e., chemotherapy and surgery. Most patients with breast cancer, however, lack the necessary knowledge regarding disease treatment options and the side effects associated with these options to make proper treatment decisions [7].

With the development of mobile networks, social media has become an important source of health information for breast cancer patients [8]. WeChat public accounts (WPAs) of WeChat have become an indispensable information dissemination platform for Chinese government agencies, medical institutions, enterprises and individuals [911], and gained 360 million readers and over 20 million registered accounts [10]. In Western countries, 29%–57% of breast cancer patients have searched the Internet for health-related information [1214]. Zhang X surveyed 1,636 Chinese WeChat users and found that 97.68% had read health information via WeChat, and 53.36% mainly obtained health information via WPAs [9]. Furthermore, it was reported that the patients with breast cancer paid long-term attention to the related WPAs [1519].

Readability is an important indicator for assessing whether the material can be effectively read and understood by readers [20]. Health messages with high readability are beneficial to help patients remember medical information [21], improve treatment compliance [22], and facilitate doctor-patient communication [23]. Conversely, materials with low readability can cause difficulty for patients in understanding treatment options and increase their negative emotions [24]. For individuals with breast cancer, factors related to the layout and design of the reported health information may support the comprehensibility of patient education materials (PEMs) [25]. However, people are increasingly skeptical about the readability of health information released through WPAs [26]. To ensure the authenticity and security of WPAs, Tencent provides authentication services for WPAs. The authentication information and the WeChat Authentication Unique Identity are displayed in the authentication details of the account. However, authentication is not mandatory.

Currently, the readability of health information on topics such as mastectomy, breast cancer risk assessment tools, and postoperative breast reconstruction has been evaluated. However, their overall readability levels were beyond the officially recommended sixth grade reading level, which makes it difficult for the public to read and understand [7,15,2732]. However, there has been no previous research undertaken to assess and compare the readability levels of different types of breast cancer treatment information in WPAs. The present study, therefore, assessed the readability of information available in WPAs regarding different treatment options in terms of non-textual factors for breast cancer to clarify the dimensions of relatively high and low readability of each type of information, and to help WPA producers focus on improving the readability of this information. This article is part of our study named “quality and readability evaluation on breast cancer treatment information on WPAs” and another paper about the quality of information has been published [33].

Methods

Sample selection

On April 11, 2021, the observer (WY) first retrieved articles and WPAs with the keywords “breast cancer” from both Sogou WeChat website (https://weixin.sogou.com/) and WeChat client and obtained WPAs by tracing the publisher of articles. We included the WPAs those WeChat profile pages clearly indicated that they provided health information for patients with BC. The exclusion criteria were as follows: the WPAs (1) were duplicate; (2) had not updated for more than one year; (3) delivered only academic research information to professionals; (4) whose target population were not only patients with BC. Two independent observers (BL and WY) screened the retrieved WPAs according to the information in WPA’s profile page. Any discrepancies between the observers were resolved by discussing with a third author (ML) for consensus. Of 1332 retrieved WPAs, 41 were included in the analysis.

The article sample pool was formed by taking four articles that were newly released by each WPA on the survey date (April 27, 2021) for a total of 164 articles. Next, two

observers (BL and WY) independently selected the articles and any disagreements were resolved with an open discussion and consensus. Articles which provided information on breast cancer treatment options were included in the present study, while the exclusion criteria were as follows: (1) duplication; (2) only providing pictures, videos, and links to articles; (3) content of academic articles not read by the public; and (4) non-chinese articles. Finally, 136 articles published by 37 WPAs were included. Four WPAs were further excluded because they lacked breast cancer treatment articles. Fig 1 illustrates the search process. No patient health information was involved in the 136 articles included in this study.

thumbnail
Fig 1. Screening process of WeChat public accounts (WPAs) and breast cancer treatment-related articles.

https://doi.org/10.1371/journal.pone.0317032.g001

Evaluation tools

Basic characteristics information table.

The following information was collected: WPA name, article title, and treatment options. WPA owners, as listed on the WPAs’ profile page, were categorized into individuals (e.g., physicians), enterprises (e.g., companies), institutions (e.g., public hospitals), and non-profit organizations (e.g., academic conferences). Breast cancer treatment options are classified as surgery, medical treatment (eg, radiation therapy, chemotherapy, endocrine therapy, targeted therapy, clinical trials, other), CAM (eg, complementary therapies, alternative therapies), and comprehensive treatment. Further, we identified several subgroup if a treatment option was classified as medical treatment or CAM. For example, if the treatment option was classified as a “CAM”, we would further code it as a “complementary therapy” or “alternative therapy”. The detailed information about 37 WPAs and 136 articles were provided in the S1 File.

The Suitability Assessment of Materials (SAM).

The Suitability Assessment of Materials (SAM) was created by Doak et al in 1996 [34]. This tool is widely used to assess the readability of online health education materials [3538], and is based on a scale, totaled from 22 items, consisting of the following 6 dimensions: content (4 items), literacy demand (5 items), graphics (5 items), layout and typography (3 items), learning stimulation and motivation (3 items), and cultural appropriateness (2 items). Each item is rated from 0 to 2 (0, “not suitable”; 1, “adequate”; 2, “superior”), and if there is something that cannot be assessed, based on the criteria of that item, it is rated as not suitable (N/A), and 2 points are subtracted from the total score. In 2013, the tool was translated into Chinese by Xianwen Li [39]. In the original scale, the Flesch-Kincaid readability formula was used to assess the “reading level” of the literacy demand dimension. As there was no readability formula in China to match this item, the item was deleted in the Chinese version of SAM. So we used the tool consisted of 21 items to evaluate the readability of the 136 articles included in the present study. The dimension and total scores of the scale were calculated as a score rate (material score/total score × 100%) and were divided into the following three levels: superior (70–100%), adequate (40–69%), and not suitable (0–39%). See S2 File for dimension and item details of the Chinese version of the Suitability Assessment of Materials (SAM). The overall inter-rater reliability of the SAM scale in the present study was 0.75, indicating substantial agreement [40], while the dimensions ranged from 0.69–0.9.

Rating process

Two postgraduate medical students (ML and WY) with extensive assessment experience assessed 136 articles referencing the SAM Handbook. Five identical articles were firstly evaluated by the two observers in order to ensure their inter-rater consistency. To maintain the integrity of the data, the researchers sorted the 136 included articles by serial number and then shared them sequentially in a WeChat group. To simulate a real-life reading situation, the evaluations were conducted on the WeChat app. The two observers used SAM to evaluate the readability of all the articles. If there were inconsistencies in the score of an item between the two observers, they attended to reach a consensus through discussion. See S3 File for item and dimension scores of 136 articles based on different treatment options and subgroups.

Statistical analysis

SPSS 27.0 for Windows (IBM, Chicago, IL, USA) and Excel 2016 software were used to analyze the data in the present study. The Shapiro-Wilk test was used to determine whether the data were normally distributed. The measurement data in the present study are expressed as median and interquartile range (IQR) due to non-normal distribution, while the count data are described as frequency, composition ratio, and rate. Readability scores for various breast cancer treatment regimens were compared using the rank sum test, which were also used to compare different medical treatment subgroups and CAM protocols separately, and multiple comparisons were performed using the Kruskal-Wallis test (K-W test). Differences were considered statistically significant at P < 0.05.

Results

Characteristics of the included WPAs and articles

Among the 37 WPAs, individual users accounted for the largest share (20, 54%), businesses (8, 22%), institutions (6, 16%), and nonprofit organizations (3, 8%). Of the 136 articles included, 74 (54%) were in regards to medical treatments, accounting for the highest percentage, with 27 (36%) on chemotherapy and 26 (19%) on CAM treatments, of which 76% were complementary. Fig 2 shows the details the composition of the articles.

Overall readability score

The SAM scores of 136 articles included in the present study ranged from 14 to 76, with a median score of 50 (IQR, 41–60), indicating that the overall readability of health information on breast cancer treatment was “adequate”. The 3 of the articles (2%) were rated as “superior”, 104 (77%) were rated as “adequate”, and 29 (21%) were rated as “not suitable”. According to the scores for each dimension, the readability of layout and typography was rated as “superior”, while the content, literacy demand, learning stimulation and motivation, and cultural appropriateness were rated as “not suitable”.

Comparison of the readability of articles regarding different treatment options

In regards to the total score, the readability of the CAM articles was higher than that of the medical (P < 0.001) and comprehensive (P = 0.03) treatment articles. A comparison of the total readability scores and the scores for each dimension of the articles presenting different treatment options is seen in Table 1.

thumbnail
Table 1. Comparison of SAM scores across dimensions based on treatment options.

https://doi.org/10.1371/journal.pone.0317032.t001

In terms of dimensional scores, the differences among the scores for content, learning stimulation and motivation, and cultural adaptability were statistically significant (P < 0.05), with the readability rating of the medical treatment articles being “not suitable” for learning stimulation and motivation. Fig 3 shows the details of the SAM scores for the different types of breast cancer treatments. For the content dimension, the readability scores of the CAM articles were higher than those of the medical (P < 0.001) and surgical (P = 0.04) treatment articles. In the learning stimulation and motivation dimension, the readability scores of the CAM articles were higher than those of the medical (P = 0.001) and surgical (P = 0.04) treatment articles. And in the cultural appropriateness dimension, the readability scores of the CAM articles were higher than those of the medical (P = 0.01) and comprehensive (P = 0.013) treatment articles.

thumbnail
Fig 3. Grades for SAM scores based on treatment options (n = 136).

https://doi.org/10.1371/journal.pone.0317032.g003

Table 2 shows a comparison of the median SAM scores of each dimension for the articles discussing medical treatment subgroups. In terms of overall scores, the readability scores of articles regarding clinical trials were lower than those of chemotherapy (P < 0.001) and radiotherapy (P = 0.03) articles. In terms of dimensional scores, the differences among the scores for content, literacy demand, graphics, learning stimulation and motivation, and cultural appropriateness were statistically significant (P < 0.05), with a readability rating of “not suitable” for clinical trial therapy articles for the content, graphics, learning stimulation, and motivation dimensions. The readability rating of the targeted therapy articles was “not suitable” for the literacy demand dimension.

thumbnail
Table 2. Comparison of SAM scores across dimensions based on medical treatment subgroup.

https://doi.org/10.1371/journal.pone.0317032.t002

Fig 4 shows the SAM scores for each dimension for the articles regarding the different medical treatment subgroups. For the content dimension, the readability score of clinical trial articles was lower than that of chemotherapy articles (P = 0.006). For the literacy demand dimension, the readability score of chemotherapy articles was higher than that of targeted therapy articles (P = 0.005). For the graphics dimension, the readability score of the clinical trial articles was lower than that of the chemotherapy articles (P = 0.002). For the learning stimulation and motivation dimension, the readability scores were lower for the clinical trials articles than for the chemotherapy (P = 0.003) and radiation therapy (P = 0.048) articles. And for the cultural appropriateness dimension, the readability score of the chemotherapy articles was higher than that of targeted therapy articles (P = 0.018).

thumbnail
Fig 4. Grades for SAM scores based on medical treatment subgroup (n = 74).

https://doi.org/10.1371/journal.pone.0317032.g004

Table 3 shows a comparison of the median SAM scores of each dimension for the articles discussing the different CAM subgroups. The readability scores of the complementary therapy articles were higher than those of the alternative therapy articles. Fig 5 shows the SAM scores of the different CAM subgroups. Complementary therapy articles had a higher readability score than the alternative therapy articles for the literacy demand (P = 0.001) and cultural appropriateness dimensions (P = 0.003), with alternative therapy articles rated as “not suitable” for the literacy demand dimension.

thumbnail
Fig 5. Grades for SAM scores based on CAM subgroup (n = 26).

https://doi.org/10.1371/journal.pone.0317032.g005

thumbnail
Table 3. Comparison of SAM scores across dimensions based on CAM subgroup.

https://doi.org/10.1371/journal.pone.0317032.t003

Discussion

To our knowledge, this is the first study to assess and compare the readability of different treatment types of information for breast cancer in WPAs. It was found that the readability of information about breast cancer treatment options in WPAs was “adequate” and there were some significant differences in some dimensions between the articles on different types. The results of this study could be seen as a valuable reference for the authors and editors of treatment information in WPA to improve readability.

Of the 136 articles included in the present study, 74 (54%) described medical treatment options, with chemotherapy accounting for 27 of those, the highest percentage (36%). Patients with breast cancer, in every stage except 0, require medical treatment at some point, especially chemotherapy [41,42]. According to a previous survey, one of the most common forms of systemic treatment for breast cancer is chemotherapy, with as many as 80% of breast cancer patients receiving chemotherapy [43,44]. The large number of breast cancer patients receiving chemotherapy creates a high demand for health information about this treatment, which may be the reason that chemotherapy encompasses the majority of medical treatment-related articles the present study. Complementary therapies were discussed in 20 of the CAM treatment articles, the highest percentage (77%). Fatmah studied the use of CAM among breast cancer patients in Saudi Arabia, and found that complementary therapies, such as diet and nutritional supplements, were the most widely used component of CAM, which is consistent with the results of the present study [45]. The high percentage of articles related to complementary therapies may be explained by the fact that dietary recommendations are easier for breast cancer patients to learn and put into practice than alternative therapies, and therefore reading interest is higher [46].

The SAM scale was used to assess readability, and 29 of the 136 articles (21%) were rated as “unsuitable”. Analysis of the reasons found that most articles did not clearly state the purpose of the graphics to the reader, graphics were not closely related to the text, and the articles lacked captions for the graphics or did not explain the diagrams. A previous study showed that readers could remember an additional 35% of the information they read, given a combination of graphic and text health information [47,48]. Therefore, the suggestions were proposed as follows: the article cover should state the purpose of the articles to the readers, the article content should be illustrated with pictures which should be clear and captioned and closely related to the text,and necessary explanations should be provided for the information presented in graphs or charts.

In the present study, when analyzing the readability of information on different treatment options for breast cancer, we found that the readability of articles in the CAM category was higher for the content, learning stimulation, and motivation dimensions than for the medical and surgical treatment options. Readability was also higher for the cultural appropriateness dimension of CAM than for the comprehensive and medical treatment options. Compared with CAM articles, the medical treatment articles focused too much on the mechanisms of drug action without clearly describing the method of taking the medication and any associated precautions, and provided more information than patients could accept. Additionally, there was a lack of case studies or interactive issues. Doak pointed out that interactive aspects of the material (e.g., asking the reader to answer certain questions, having the reader fill out a self-assessment form, etc.) could increase the reader’s sense of engagement in the reading, reinforce motivation to learn, and deepen memory [34]. The cultural appropriateness dimension of the comprehensive treatment articles scored lower than that of the CAM articles, likely because the articles published on WPAs requiring shorter and more concise content [49], while comprehensive treatment focused on the mechanism of action of the treatment when describing two or more treatments, which did not match the literacy level of the readers. Therefore, in the content dimension, when producing medical treatment articles for WPAs, producers attached links to references at the end of the articles for the description of the drug mechanism of action, and add a description of the behavioral information in the body of the article. In the learning stimulation and motivation dimension, medical treatment articles could provide real cases or questions for readers to think and answer, so that readers can interact with the material and improve their interest in reading [34]. In the cultural appropriateness dimension, when producing comprehensive treatment articles, it is recommended to use 3D modeling and animation videos in the article to explain the mechanism of action of treatment methods, so as to reduce the difficulty of readers to understand professional terms.

In the present study, we compared the readability of articles in different subgroups of medical treatments, and found that the readability of chemotherapy articles was higher than that of clinical trial articles for the content, graphics, and learning stimulation and motivation dimensions, and higher than that for the literacy demand and cultural appropriateness dimensions of targeted therapy articles. According to the circular “Clinical value-oriented clinical development guidelines for antineoplastic drugs” issued by the Chinese Drug Review Center of the State Drug Administration 2021 [50], participation of oncology patients in clinical trials was identified as a means of treatment. One study showed that 25% of patients with cancer used the Internet to find information about clinical trials [51]. However, clinical trial articles provided little information about behavioral skills and applications of the information described, which are precisely what patients are most interested in and want to read [34]. Thirteen (100%) of the articles in the clinical trials category did not use pictures or diagrams, case studies, or a question-and-answer format for interactive design, which may decrease patient interest and motivation [38]. Therefore, the readability rating of the clinical trial articles was “not suitable” for the content, graphics, and learning stimulation and motivation dimensions. As such, it is suggested that the elaboration of behavioral information should be increased when producing clinical trial articles, that complex or comparative information should be presented in a table form, that articles include real cases or raise questions for readers to think about. Compared with the chemotherapy articles, the readability rating of the literacy demand dimension of the targeted therapy articles was “not suitable”, largely because the targeted therapy articles used more medical terms without defining them upon their first use, which affected the overall expression of the article and made it harder to understand. In view of this, it is suggested that when producing targeted therapy articles, medical terminology should be minimized or explained when it appears for the first time. And animation could be used to express the mechanism of action of targeted drugs.

In the readability analysis of the articles discussing CAM therapy subgroups in the present study, we found that the readability of complementary therapy articles was higher for the literacy demand and cultural appropriateness dimensions than in alternative therapy articles. The alternative therapy articles often used specialized terminology. And most of the articles on alternative therapies had fewer examples and were purely theoretical, which did not fit with the patients’ life experiences. Therefore, it is recommended that more well-known words be used, rather than jargon or terminology, thereby increasing readers’ interest in reading [52]. It is also recommended to introduce alternative breast cancer therapies with more examples relevant to patients’ life experiences.

The present study had several advantages. First, common search strategies used by the public were mimicked to generate WPAs that were likely to be commonly read by the public. Secondly, two evaluators independently reviewed the webpages and compared the results to reduce subjectivity. Thirdly, breast cancer treatment information was categorized by type to explore the readability profiles and attributes of each treatment type from a new perspective.

On the other hand, the present study also had some limitations. First, our web search was not exhaustive, and the online health information obtained from the search should be more extensive and not only based on idiosyncratic searches. Patients may also use other combinations of search terms that yield relevant results, which may include more comprehensive information about breast cancer treatment options. Secondly, the present study only evaluated online information on breast cancer treatment options presented in Chinese, and the findings, therefore, may not apply to other languages. Thirdly, the articles included in the present study were limited to WPAs already published on April 11, 2021. It is worth noting that different results are generated additional WPAs are published or updated.

Conclusion

According to the SAM scale scores, the overall readability of WPA-based health information on different treatment options for breast cancer is “adequate”. The readability score of CAM treatment articles was higher than that of medical and comprehensive treatment articles, while medical treatment articles had “not suitable” ratings for the learning motivation and motivation dimensions. We also found that the readability rating of the clinical trial treatment articles in the medical treatment category was “not suitable” in terms of content, graphics, and learning stimulation and motivation dimensions. Publishers of health information on WPAs must understand the factors influencing the readability of the different breast cancer treatment options, and adopt strategies to improve readability to enhance the effectiveness of disseminating the treatment information.

Supporting information

S1 File. Basic information of 37 WeChat public accounts and 136 breast cancer treatment articles.

https://doi.org/10.1371/journal.pone.0317032.s001

(XLSX)

S2 File. The Chinese version of the Suitability Assessment of Materials (SAM).

https://doi.org/10.1371/journal.pone.0317032.s002

(DOCX)

S3 File. The SAM item and dimension scores of 136 articles based on different treatment options and subgroup.

https://doi.org/10.1371/journal.pone.0317032.s003

(XLSX)

Acknowledgments

We would like to express our gratitude to all who contributed to the writing of this article.

References

  1. 1. Sung H, Ferlay J, Siegel RL, et al. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J Clin. 2021;71(3):209–249. pmid:33538338
  2. 2. Cao W, Chen HD, Yu YW, et al. Changing profiles of cancer burden worldwide and in China: a secondary analysis of the global cancer statistics 2020. Chin Med J (Engl). 2021;134(7):783–791. Published 2021 Mar 17. pmid:33734139
  3. 3. Harrison JD, Young JM, Price MA, et al. What are the unmet supportive care needs of people with cancer? A systematic review. Support Care Cancer. 2009;17(8):1117–1128. pmid:19319577
  4. 4. Halbach SM, Ernstmann N, Kowalski C, et al. Unmet information needs and limited health literacy in newly diagnosed breast cancer patients over the course of cancer treatment. Patient Educ Couns. 2016;99(9):1511–1518. pmid:27378079
  5. 5. Hortobagyi GN. Toward individualized breast cancer therapy: translating biological concepts to the bedside. Oncologist. 2012;17(4):577–584. pmid:22474069
  6. 6. Alraek T, Lee MS, Choi TY, et al. Complementary and alternative medicine for patients with chronic fatigue syndrome: a systematic review. BMC Complement Altern Med. 2011;11:87. Published 2011 Oct 7. pmid:21982120
  7. 7. Tran BNN, Singh M, Singhal D, et al. Readability, complexity, and suitability of online resources for mastectomy and lumpectomy. J Surg Res. 2017;212:214–221. pmid:28550909
  8. 8. Aristokleous I, Karakatsanis A, Masannat YA, et al. The Role of Social Media in Breast Cancer Care and Survivorship: A Narrative Review. Breast Care (Basel). 2023;18(3):193–199. pmid:37404835
  9. 9. Zhang X, Wen D, Liang J, et al. How the public uses social media wechat to obtain health information in china: a survey study. BMC Med Inform Decis Mak. 2017;17(Suppl 2):66. Published 2017 Jul 5. pmid:28699549
  10. 10. 2021 WeChat open class PRO [Internet]. Available from: https://new.qq.com/rain/a/20210120A00ZQ700
  11. 11. Shen L, Wang S, Chen W, et al. Understanding the Function Constitution and Influence Factors on Communication for the WeChat Official Account of Top Tertiary Hospitals in China: Cross-Sectional Study. J Med Internet Res. 2019;21(12):e13025. Published 2019 Dec 9. pmid:31815674
  12. 12. Valero-Aguilera B, Bermúdez-Tamayo C, García-Gutiérrez JF, et al. Information needs and Internet use in urological and breast cancer patients. Support Care Cancer. 2014;22(2):545–552. pmid:24122406
  13. 13. Littlechild SA, Barr L. Using the Internet for information about breast cancer: a que- stionnaire-based study. Patient Educ Couns. 2013;92(3):413–417. pmid:23891419
  14. 14. Nguyen SK, Ingledew PA. Tangled in the breast cancer web: an evaluation of the usage of web-based information resources by breast cancer patients. J Cancer Educ. 2013;28(4):662–668. pmid:23832398
  15. 15. Li Y, Ye S, Zhou Y, et al. Web-Based Medical Information Searching by Chinese Patients With Breast Cancer and its Influence on Survival: Observational Study. J Med Internet Res. 2020;22(4):e16768. Published 2020 Apr 17. pmid:32301740
  16. 16. Xu J, Li J. Grounded Theory-based Behaviors Research of Chronic Patient’s Health Information Seeking: Case Study of WeChat Platform. Inf Res. 2019;(11):63–8.
  17. 17. Chen X, Zhou X, Li H, et al. The value of WeChat application in chronic diseases management in China. Comput Methods Programs Biomed. 2020;196:105710. pmid:32858284
  18. 18. Bian D, Shi Y, Tang W, et al. The Influencing Factors of Nutrition and Diet Health Knowledge Dissemination Using the WeChat Official Account in Health Promotion. Front Public Health. 2021;9:775729. Published 2021 Nov 25. pmid:34900917
  19. 19. Sun L, Tao Y, Zhu S, Liu K. A randomized controlled trial of WeChat-based cognitive behavioral therapy intervention to improve cancer-related symptoms in gynecological cancer survivors: study protocol. BMC Health Serv Res. 2022;22(1):1052. Published 2022 Aug 17. pmid:35978353
  20. 20. Qiuyi W, Lunfang Xie, Lei W, et al. Review on readability assessment tools for health education materials. Chinese Journal of Health Education, 2019,35(01):66–71.
  21. 21. Park J, Seale H. Examining the online approaches used by hospitals in Sydney, Australia to inform patients about healthcare associated infections and infection prevention strategies. BMC Infect Dis. 2017;17(1):788. Published 2017 Dec 21. pmid:29268700
  22. 22. Lindquist LA, Go L, Fleisher J, et al. Relationship of health literacy to intentional and unintentional non-adherence of hospital discharge medications. J Gen Intern Med. 2012;27(2):173–178. pmid:21971600
  23. 23. Sustersic M, Gauchet A, Foote A, et al. How best to use and evaluate Patient Information Leaflets given during a consultation: a systematic review of literature reviews. Health Expect. 2017;20(4):531–542. pmid:27669682
  24. 24. Guan Y, Maloney KA, Roter DL, et al. Evaluation of the Informational Content, Readability and Comprehensibility of Online Health Information on Monogenic Diabetes. J Genet Couns. 2018;27(3):608–615. pmid:28951986
  25. 25. Fortuna J, Riddering A, Shuster L, et al. Assessment of online patient education materials designed for people with age-related macular degeneration. BMC Ophthalmol. 2020;20(1):391. Published 2020 Oct 2. pmid:33008367
  26. 26. Chi H. The spread and governance of health rumours disseminated in Wechat Public Account. Research on Digital Media 2018;35(5):27–30.
  27. 27. Bruce JG, Tucholka JL, Steffens NM, et al. Quality of online information to support patient decision-making in breast cancer surgery. J Surg Oncol. 2015;112(6):575–580. pmid:26417898
  28. 28. Basch CH, MacLean SA, Garcia P, et al. Readability of online breast cancer information. Breast J. 2019;25(3):562–563. pmid:30972837
  29. 29. Miles RC, Baird GL, Choi P, et al. Readability of Online Patient Educational Materials Related to Breast Lesions Requiring Surgery. Radiology. 2019;291(1):112–118. pmid:30694156
  30. 30. Arif N, Ghezzi P. Quality of online information on breast cancer treatment options. Breast. 2018;37:6–12. pmid:29040893
  31. 31. Kemp E, Koczwara B, Butow P, et al. Online information and support needs of women with advanced breast cancer: a qualitative analysis. Support Care Cancer. 2018;26(10):3489–3496. pmid:29693203
  32. 32. Lynch NP, Lang B, Angelov S, et al. Breast reconstruction post mastectomy- Let’s Google it. Accessibility, readability and quality of online information. Breast. 2017;32:126–129. pmid:28178606
  33. 33. Yang W, Li B, Liu M, et al. Quality evaluation of health information about breast cancer treatment found on WeChat public accounts. Arch Public Health. 2023;81(1):170. Published 2023 Sep 15. pmid:37715269
  34. 34. DOAK C C, DOAK L G, ROOT J H. Teaching patients with low literacy skills[M]. 2nd ed. Philadelphia: Lippincott Company, 1996:1.
  35. 35. Hoffmann T, Ladner Y. Assessing the suitability of written stroke materials: an evaluation of the interrater reliability of the suitability assessment of materials (SAM) checklist. Top Stroke Rehabil. 2012;19(5):417–422. pmid:22982829
  36. 36. Taylor-Clarke K, Henry-Okafor Q, Murphy C, et al. Assessment of commonly available education materials in heart failure clinics. J Cardiovasc Nurs. 2012;27(6):485–494. pmid:21743339
  37. 37. Ryan L, Logsdon MC, McGill S, et al. Evaluation of printed health education materials for use by low-education families. J Nurs Scholarsh. 2014;46(4):218–228. pmid:24597957
  38. 38. Tian C, Champlin S, Mackert M, et al. Readability, suitability, and health content assessment of web-based patient education materials on colorectal cancer screening. Gastrointest Endosc. 2014;80(2):284–290. pmid:24674352
  39. 39. Li Xianwen. Suitability evaluation of the health education text material and the health literacy intervention of Korean-Chinese older adults with hypertension. [D] Yanjie: Yanbian University, 2013.
  40. 40. De Raadt A, Warrens MJ, Bosker RJ, et al. Kappa Coefficients for Missing Data. Educ Psychol Meas. 2019;79(3):558–576. pmid:31105323
  41. 41. Parker PD, Heiney SP, Friedman DB, et al. The Experience of Chemotherapy Teaching and Readability of Chemotherapy Educational Materials for Women with Breast Cancer. J Cancer Educ. 2021 Feb;36(1):47–55. pmid:31392598
  42. 42. Sun Yan. Reunderstanding of medical treatment of breast cancer. Chinese Journal of Oncology 1999(03): 78–80.
  43. 43. De Veirman. National Cancer Institute. Breast cancer treatment. Cancer Trends Progress Report 2018 [cited 2018 May 6]; Available from: https://progressreport.cancer.gov/treatment/breast_cancer. Frontiers in Psychology, 2019. 10.
  44. 44. American Cancer Society Chemotherapy for breast cancer. [cited 2018 5/1]; Available from: https://www.cancer.org/cancer/breast-cancer/treatment/chemotherapy-for-breast-cancer.html. Chinese Nursing Management, 2021. 21(12): p. 1894–1898.
  45. 45. Alsharif FH, Mazanec SR. The use of complementary and alternative medicine among women with breast cancer in Saudi Arabia. Appl Nurs Res. 2019;48:75–80. pmid:31266612
  46. 46. Liu Feifan. Research on social support model on WeChat public platform of Patients circle Take “Mutual circle of breast cancer” as an example [D]. Zhongnan University of Economics and Law, 2019.
  47. 47. Hill B, Perri-Moore S, Kuang J, et al. Automated pictographic illustration of discharge instructions with Glyph: impact on patient recall and satisfaction. J Am Med Inform Assoc. 2016;23(6):1136–1142. pmid:27234601
  48. 48. Van Beusekom MM, Grootens-Wiegers P, Bos MJ, et al. Low literacy and written drug information: information-seeking, leaflet evaluation and preferences, and roles for images. Int J Clin Pharm. 2016;38(6):1372–1379. pmid:27655308
  49. 49. Wang F, Wang Z, Sun W, et al. Evaluating the Quality of Health-Related WeChat Public Accounts: Cross-Sectional Study. JMIR Mhealth Uhealth. 2020;8(5):e14826. Published 2020 May 8. pmid:32383684
  50. 50. https://www.cde.org.cn/main/news/viewInfoCommon/ef7bfde96c769308ad080bb7ab2f538e.
  51. 51. Cortez S, Milbrandt M, Kaphingst K, et al. The readability of online breast cancer risk assessment tools. Breast Cancer Res Treat. 2015;154(1):191–199. pmid:26475705
  52. 52. Hoffmann T, Worrall L. Designing effective written health education materials: considerations for health professionals. Disabil Rehabil. 2004;26(19):1166–1173. pmid:15371031