Reports of regulatory and evidentiary gaps have raised concerns about the marketing and use of natural health products (NHPs). The majority of NHPs offered for sale are purchased at a community pharmacy and pharmacists are “front-line” health professionals involved in the marketing and provision of NHPs. To date, the involvement of pharmacists in pharmacy care involving NHPs and the degree to which concerns over the safety, efficacy, marketing and regulation of NHPs are addressed in pharmacy care in Canada have not been studied.
Using Qualtrics, a web-based data collection and analysis software, and a study instrument made up of fifteen (15) open-ended, closed and rating scale questions, we surveyed the attitudes and practices of 403 community pharmacists in the Canadian province of Alberta regarding NHPs offered for sale in community pharmacies.
The majority of pharmacists surveyed (276; 68%) recommend NHPs to clients sometimes to very often. Vitamin D, calcium, multivitamins, prenatal vitamins, probiotics and fish oil and omega-3 fatty acids were the most frequently recommended NHPs. The most common indications for which NHPs are recommended include bone and musculoskeletal disorders, maintenance of general health, gastrointestinal disorders and pregnancy. Review articles published in the Pharmacist’s Letter and Canadian Pharmacists Journal were the primary basis for recommending NHPs. The majority of pharmacists surveyed (339; 84%) recommend the use of NHPs concurrently with conventional drugs, while a significant number and proportion (125; 31%) recommend alternative use. Pharmacists in the study overwhelmingly reported providing counselling on NHPs to clients based on information obtained mainly from the Natural Medicines Comprehensive Database.
The study findings indicate a high prevalence of pharmacy care relating to NHPs among study participants. Although pharmacists’ practices around NHPs are consistent with the existing licensing framework, we found some involvement in problematic practices that necessitate further research and potential policy scrutiny. The study also uncovered patterns of recommendations, including sources relied on in recommending NHPs and in providing counselling to patients, that raise concerns about the quality and credibility of NHP-related care provided to pharmacy patrons.
Citation: Ogbogu U, Necyk C (2016) Community Pharmacists’ Views and Practices Regarding Natural Health Products Sold in Community Pharmacies. PLoS ONE 11(9): e0163450. https://doi.org/10.1371/journal.pone.0163450
Editor: Dermot Cox, Royal College of Surgeons in Ireland, IRELAND
Received: March 26, 2016; Accepted: September 8, 2016; Published: September 23, 2016
Copyright: © 2016 Ogbogu, Necyk. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data files are included with the submitted manuscript as Supporting Information.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Natural health products (NHPs) are “naturally occurring substances,” including vitamins, minerals, herbal remedies, homeopathic medicines, traditional medicines, probiotics, amino acids and fatty acids that are “used and marketed for…the prevention or treatment of an illness or condition, the reduction of health risks, or the maintenance of good health” . Studies published in the present decade have reported increased use of NHPs both within Canada and internationally [2–5]. A recent national survey in Canada found that 73% of adult Canadians took at least one NHP in 2010 . A third of the individuals in the same survey reported taking three or more NHPs concurrently . Uses of NHPs in the pediatric population have also been reported . Reasons for using NHPs are many and varied, including an increased interest in natural approaches to disease prevention, the perception or belief that NHPs are better than conventional pharmaceutical drugs, media advertising, and recommendations from family and friends [5,7].
A common rationale for the prevalent use of NHPs is that consumers believe that they are either safe or safer than pharmaceuticals [5,7]. However, the safety profiles of commonly used NHPs are understudied and there is limited high quality, credible research evidence to support the safety of NHPs [8–11]. Adverse events have been documented for a number of NHPs, especially when used concurrently with conventional drugs [12–13]. Such adverse events include intrinsic effects related to pharmacologic action, toxicity, dosage and interaction with other drugs, as well as extrinsic effects related to contamination issues and manufacturing and labelling errors [14–16]. For example, ephedra, a natural health product marketed as a stimulant and weight-loss supplement, has been linked to hypertension, tachycardia and anxiety . In 2004, the United States Food and Drug Administration (FDA) banned the sale of dietary supplements containing ephedra due to the “unreasonable risk of…cardiovascular complications and…death” . Another well-known natural health product, St. John’s wort (Hypericum perforatum), is highly interactive and can lead to adverse effects when taken concurrently with other medications such as antidepressants and oral contraception . Extrinsic effects have been reported for black cohosh (Actaea racemosa), where hepatotoxicity may be linked to Chinese Actaea species found in the product rather than black cohosh itself .
Evidence on the efficacy of NHPs is also limited and inconclusive. While some NHPs have been shown to be effective for treating specific indications, such as the use of calcium and Vitamin D for preventative treatment of osteoporosis in the elderly , others lack good quality evidence to support the uses for which they are marketed [21–22]. For example, glucosamine is marketed as a treatment for osteoarthritis. It is available by prescription in Europe and as an over-the-counter purchase in North America [21–22]. A 2008 Cochrane review of randomized controlled trials that evaluated the effectiveness of glucosamine for the treatment of osteoarthritis concluded that one specific type, glucosamine sulphate, administered orally at a specified dose, produced some benefit in pain management . However, the review also found that “if only the best designed studies” are considered, this benefit “is no longer present” and that “the high quality studies [included in the review] showed that pain improved about the same whether people took glucosamine or fake pills” .
Given the popularity of, and demand for, NHPs, it is not surprising that they have entered the market despite limited evidence of safety or efficacy. There are currently over 70,000 NHPs licensed for sale in Canada and NHPs are the top over-the-counter category in terms of sales. Canadian consumers spend about $8.83 per capita on NHPs and the total yearly spending on popular NHPs including vitamins, dietary supplements and herbal remedies exceeded $1.5 billion in 2015 [23–26]. In addition, most major pharmacy chains in Canada now have aisles and counters dedicated to NHPs.
The increased availability of NHPs is partly aided by a regulatory system that imposes less scrutiny on NHPs prior to market entry compared to that imposed upon pharmaceuticals. NHPs offered for sale in Canada must be licensed and approved by the Natural and Non-Prescription Health Product Directorate (NNHPD), a branch of Health Canada. However, evidentiary and licensing requirements for NHPs are significantly more relaxed relative to the requirements for the licensing of pharmaceuticals [25–28]. While this approach may seem justified, given that NHPs are sold over-the-counter and without a prescription, it also allows for faster, easier and unencumbered market entry for NHPs. The licensing system has been described as “a joke”  and criticized for creating “a loophole through which manufacturers can sell a product with implied health benefits without having to obtain the supporting scientific evidence that would be needed if it were sold as a drug” . A recent investigation conducted by CBC Marketplace into the licensing of NHPs in Canada highlights the latter criticism . The investigation revealed that Health Canada approved a fake homeopathic product designed to provide “effective relief of fever, pain and inflammation” in children based solely on a claim of effectiveness derived from a 1902 homeopathic reference book . The controversy and widespread public outcry that followed the Marketplace investigation led to changes to Health Canada’s policies around labeling and health claims for nosodes and homeopathic cough, cold and flu products for children .
NHPs approved for sale in Canada are assigned a Natural Health Product Number (NPN) (or Homeopathic Medicine Number (DIN-HM) in the case of homeopathic medicines) that must appear on the packaging of the product. It is presently unclear how product approval numbers and the licensing process for NHPs are perceived by members of the public and health professionals involved in the marketing of NHPs. However, concerns have been raised that the licensing process and issuance of product numbers may convey the impression that licensed NHPs are safe and efficacious for the purposes for which they are marketed . To add to this concern, many patients do not report uses of NHPs to their health care providers and are less likely to attribute adverse events to NHPs, due to the belief that NHPs are inherently safe [5,31–36].
The foregoing discussion highlights significant concerns surrounding the marketing, licensing and use of NHPs in Canada. These concerns will likely have an impact on the views and practices of health care professionals who are involved in the marketing of NHPs and who are expected to provide guidance on the use of such products to consumers. Given that a majority of NHPs offered for sale are purchased at a community pharmacy , pharmacists, more than most other health care professionals, are likely to be involved in the marketing and provision of NHPs. In Alberta, pharmacists are obligated by applicable standards of practice to assist pharmacy patrons with choosing NHPs and to provide counselling regarding safe and effective uses of NHPs . However, to date, the ways in which Canadian pharmacists accomplish these roles and the degree to which concerns over the safety, efficacy, marketing and regulation of NHPs are addressed in Canadian pharmacy care have not been studied.
The objective of this study is to assess the attitudes and practices of Alberta pharmacists regarding NHPs offered for sale in community pharmacies. The study also explores Alberta pharmacists’ views of the evidentiary basis for clinical and related uses of NHPs, the indications for which NHPs are used and the regulatory process for approval and licensing of NHPs. The study aims to provide insights on the involvement of Alberta pharmacists in pharmacy care relating to NHPs, to highlight valuable or detrimental practices, and to produce information that may help shape policy and practice in relation to NHPs.
This study is based on a survey conducted on Qualtrics, a web-based data collection and analysis software. The sample population consisted of 4003 licensed pharmacists in the Canadian province of Alberta who had indicated to the Alberta College of Pharmacists that they were willing to be contacted for research purposes. As of January 1, 2016, there were 4,896 licensed pharmacists in Alberta . The sample population represents eighty-one percent (81%) of the total number of licensed pharmacists in Alberta. Data collection began on July 16, 2015. Emails with a link to the survey were sent via Qualtrics to the pharmacists in the sample population. Three emails failed or bounced, resulting in a sample of 4000 potential participants. Three reminder emails were sent out at weekly intervals, including a final reminder sent on August 10, 2015. The survey was closed on August 13, 2015, mainly due to a sharp drop in the response rate. A total of 403 pharmacists, amounting to ten percent (10%) of the sample population, participated in the survey. The number of participants represents eight percent (8%) of the total number of licensed pharmacists in Alberta.
The study instrument consisted of 15 structured questions designed using a combination of open-ended, closed and rating scale questions (see S1 File for the study questionnaire). Six questions in the survey requested general demographic information along with information on participants’ practice setting, experience and qualifications. The remaining nine questions sought to gather data on the role of pharmacists in recommending NHPs sold in community pharmacies, commonly recommended NHPs, associated indications, and counselling practices. Three of the 15 questions in the survey allowed for open-ended responses (i.e. “Other–please specify”). The study instrument was reviewed for structure and consistency with the study objectives by an assessment specialist in the Faculty of Pharmacy and Pharmaceutical Sciences, University of Alberta. The study was also reviewed and approved by the University of Alberta Research Ethics Board. A letter of invitation to participate in the study was sent by email to the 4003 pharmacists in our initial sample. The letter informed the participants that consent to participate in the study will be implied with completion of the online survey.
Survey responses were analyzed in Qualtrics. Reported statistical calculations were automatically generated in Qualtrics. To allow for a more focused analysis, only p-values less than or equal to 0.05 are reported. Open-ended responses were analyzed manually and independently and are reported as a subset of the main category (i.e. “Other–please specify”) that elicited the responses (the complete results database is included in S2 and S3 Files).
Question response rate
Of the 403 participants to the survey (403/4000 = ~10%), 396 (98%) completed the entire survey. Six participants completed 90% of the survey, while the remaining participant completed 80% of the survey. The lowest number of responses recorded per question was 399. A majority of the participants (365; 91%) completed the survey in 10 minutes, while the others spent between 20 and 150 minutes to complete it.
Qualifications, practice setting and NHP-related training
Of the 403 survey participants, 300 (75%) indicated that their practice setting was in an urban area, while 102 (25%) identified as rural pharmacists. One participant did not indicate a practice setting. Number of years spent in practice ranged from zero (or less than one) to 46 years and the average number of years spent in practice was 14.4 years. Number of hours spent weekly providing direct patient care ranged from zero to 160, with an average of 33 hours worked per week. Six of the participants had no direct patient care experience, while a majority of participants (293; 73%) spent between 30–60 hours a week providing direct patient care.
To determine the participants’ qualifications and scope of practice, the survey asked them to indicate the highest degree completed and whether they have obtained additional authorization to initiate and manage drug therapy (i.e. additional prescribing authorization). A higher proportion of participants (351; 87%) indicated that a Bachelor’s degree was the highest degree completed followed by those who have completed a Master’s degree (19; 5%), Post-Baccalaureate Doctor of Pharmacy (Post Bac Pharm D) (10; 2%) and doctorate (PhD) (6; 1%). One participant selected the entry level Doctor of Pharmacy (entry level Pharm D) as the highest degree completed and the remaining 15 participants (4%) selected the “other” category. Among the latter group, five indicated that they have obtained the Accredited Canadian Pharmacy Residency designation, four have completed hospital residencies, two have completed Master’s degrees with post graduate certificates in Clinical Studies, one participant had attained two Bachelor’s degrees and one was a certified respiratory, diabetes and tobacco educator. Two of the 15 participants that selected the “other” category did not specify highest degree completed. Only 98 participants (24%) have obtained additional prescribing authorization; the majority of participants (302; 75%) did not have this authorization.
Next, the survey sought to determine whether the participants have received training relating or specific to NHPs by asking them to indicate the number of hours spent on accredited or non-accredited learning on NHPs. A majority of the participants (343; 85%) indicated that they have spent time on NHP-related learning, while 58 participants (14%) indicated that they have not spent any time learning about NHPs. Among those who have received some training, 135 (39%) indicated they have spent one to three hours on accredited and non-accredited NHP learning, 107 (31%) have spent more than 10 hours, 78 (23%) have spent four to six hours and 23 (7%) have spent seven to 10 hours.
Recommendations relating to NHPs
The survey explored recommendations of NHPs made by community pharmacists through a series of questions regarding the most frequently recommended NHPs, the primary basis for recommending NHPs (or the source of the recommendations), frequency of recommendations and indications that NHPs are commonly recommended for. The questions in this part also probed whether participants recommend NHPs that do not have a Health Canada product number and whether participants recommend that their clients use NHPs concurrently with and/or as an alternative to conventional medicines.
Frequency of recommendations.
The survey asked participants to rate how regularly they recommend NHPs to clients on a scale of 1 to 5 with 5 being very often, 4 being often, 3 being sometimes, 2 being rarely and 1 being never. A majority of participants (182; 45%) selected sometimes followed by those who rarely recommend NHPs (114; 28%). Among the remaining participants, 71 (18%) recommend NHPs often, 23 (6%) make recommendations very often and 11 (3%) reported that they never recommend NHPs to their clients.
Frequency of recommendations of specific NHPs.
Vitamin D was selected as the most frequently recommended NHP (selected by 326 or 81% of the participants). Other most frequently recommended NHPs include calcium (310; 77%), multivitamins and prenatal vitamins (287; 71%), probiotics (265; 66%), fish oil and omega-3 fatty acids (237; 59%), iron (221; 55%), melatonin (212; 53%) and Vitamin B (177; 44%). The least recommended NHP categories were St. John’s wort (Hypericum perforatum) (12; 3%), weight loss and detoxification products (18; 4%), gingko biloba (20; 5%), ginseng (21; 5%) (Note: There are multiple species of ginseng. We did not specify ginseng species in the study questionnaire, but the most common are Panax ginseng and Panax quinquefolius), saw palmetto (Serenoa repens) (26; 6%) and garlic (Allium sativum) (26; 6%). Homeopathic products were selected as the most frequently recommended NHPs by 28 participants (7%), while 27 participants (7%) specified other products, including “PEG powder” (Polyethylene glycol-3550), “ginger” (Zingiber officinale), glucosamine, co-enzyme Q10, turmeric (Curcuma longa), curcumin, kelp (Laminariales), “herbals,” Vitamin B1, soy phytoestrogens, black cohosh (Actaea racemosa), selenium, rosemary (Rosmarinus officinalis), lysine, butterbur (Petasites hybridus), grape seed (Vitis vinifera) extract, soluble fiber, alpha-lipoic acid, N-acetylcysteine, glutathione, “greens,” “cell protectors,” “immunocal,” “EMP” (essential mineral powder), rhodiola (Rhodiola rosea) and “adrenal support” (see Table 1 for a list of NHPs arranged by frequency of recommendations and S3 File for the full list of most frequently recommended NHPs and associated responses/frequencies).
The indication for which NHPs are most commonly recommended is vitamin and/or mineral deficiency (354; 88%). Other top indications include bone and musculoskeletal disorders (237; 59%), maintenance of general health (230; 57%), gastrointestinal disorders (180; 45%), pregnancy (158; 39%), immune system support (138; 34%), pain (121; 30%), women’s health disorders (104; 26%), cardiovascular diseases (85; 21%), allergy prevention and treatment (59; 15%) and infectious diseases (58; 14%). The least frequent indications in the dataset include respiratory disorders (27; 7%), neurological disorders (35; 9%) and weight loss and detoxification (44; 11%). Thirty-five participants (9%) specified other indications, including sleep and insomnia, cough and cold, men’s health, stress related disorders, adrenal support, hematological conditions, fertility, insect bites and minor pain, alcohol withdrawal, osteoporosis and management of side effects of other medications (see Table 2 and S3 File for a full list of indications).
Primary basis for recommending NHPs/source of recommendations.
Review articles in the Pharmacist’s Letter and Canadian Pharmacists Journal were selected as the primary basis for recommending NHPs by a majority of the participants (140; 35%) followed by client requests (93; 23%) and primary literature (55; 14%). Fewer participants relied on Health Canada approval (48; 12%), recommendations or prescriptions from primary care providers (31; 8%) and manufacturer information (13; 3%) as the primary basis for recommending NHPs to clients. Only two participants rely on the Internet and social media as the primary basis for their recommendations. Nineteen participants (5%) specified other sources, including seminar education, private research, PubMed, continuing education events and programs, personal experience, the Compendium of Therapeutic Choices and the Natural Medicines Comprehensive Database (NMCD).
Natural Products Number/Homeopathic Medicines Number.
A majority of the participants (233; 58%) stated that they have not recommended NHPs that do not have a NPN or DIN-HM. The remaining participants had either recommended NHPs without a NPN or DIN-HM (46; 11%) or were not sure if they had or not (122; 30%).
Concurrent and alternative use.
A majority of participants (339; 84%) indicated that they have recommended that their clients use NHPs concurrently with conventional medicines. Forty-four participants (11%) stated that they have not recommended concurrent use, while 17 (4%) indicated that they were not sure if they had made this recommendation. Regarding alternative use, 243 participants (60%) indicated that they have not recommended NHPs as an alternative to conventional medicines, while 125 participants (31%) indicated that they have recommended alternative use. The remaining 31 participants (8%) were not sure if they had made this recommendation.
Counselling practices relating to NHPs
The remaining two questions in the survey queried the circumstances in which participants provide counselling regarding NHPs to their clients and the source of the safety and efficacy information provided during counselling. Regarding circumstances, 363 participants (90%) indicated that they provide counselling when a client inquires about NHPs. A close number and proportion of participants (353; 88%) provide counselling when recommending NHPs to clients, while 273 participants (68%) provide counselling when a client is picking up NHPs recommended by another health care provider. The number of participants who provide counselling when a client requires assistance locating NHPs in the pharmacy was 246 (61%). Four participants (1%) stated that they have never provided counselling to clients regarding the safety or efficacy of NHPs, while 11 participants (3%) specified other circumstances (see Table 3 for a list of other circumstances).
Regarding the source of safety and efficacy information provided during counselling, most participants (283; 70%) identified the NMCD as the main source of safety and efficacy information provided during counselling. Other primary sources selected by the participants include Health Canada product monographs (44; 11%), Canadian Pharmacist’s Letter (32; 8%) and the manufacturer’s product monograph (25; 6%). The fewest number of participants (16; 4%) specified other primary sources, including personal knowledge, review articles, the Compendium of Therapeutic Choices, Canadian Pharmacists Association e-Suite, Lexicomp, Medscape, Natural Standard, PubMed, science-based journals, Internet searches, the Science Based Medicine and Pharmacy Blog and “respected authors of evidence based medicine [such as] Dr. Edzard Ernst.”
Influence of frequency of NHP recommendations on counselling practices
Among participants who recommend NHPs often or very often (n = 94), more indicated that they provide counselling when recommending NHPs to clients (86; 91%) or responding to client inquiries about NHPs (80; 85%) than when clients are picking up NHPs recommended by another health care provider (71; 76%) or requesting assistance with locating NHPs in the pharmacy (64; 68%).
NHPs recommended for concurrent use
Participants who have recommended that their clients use NHPs concurrently with conventional medicines (n = 339) indicated that they most frequently recommend Vitamin D (283; 83%), calcium (275; 81%), multivitamins and prenatal vitamins (248; 73%) and probiotics (234; 69%) to their clients. Among this category of participants, 23 (7%) selected homeopathic products as the NHPs they recommend most often. The least frequently recommended NHPs by the participants in the concurrent use category include St. John’s wort (Hypericum perforatum) (11; 3%), weight loss and detoxification products (14; 4%) and gingko biloba (15; 4%).
NHP recommendations by practice setting, source of recommendation and learning
The most frequently recommended NHPs were similar for participants in rural and urban settings. However, among participants in rural practice (n = 102), a higher proportion recommend probiotics (77%), magnesium (48%), psyllium fiber (46%), zinc (21%), garlic (Allium sativum) (13%), echinacea (13%) (Note: There are multiple species of echinacea. We did not specify echinacea species in the study questionnaire but the most common is Echinacea purpurea), saw palmetto (Serenoa repens) (11%), and ginseng (8%) compared to the corresponding proportion of urban practitioners (n = 300) for the same product categories, as follows: probiotics (63%), magnesium (29%), psyllium fiber (38%), zinc (9%), garlic (Allium sativum) (4%); echinacea (9%), saw palmetto (Serenoa repens) (5%), and ginseng (4%).
Participants who rely on review articles, Health Canada approval, the primary literature and recommendations from other primary care providers as the primary basis for recommending NHPs to clients selected Vitamin D as the most frequently recommended NHP. Calcium was the most frequent recommendation for those who rely on client requests, while those who rely primarily on manufacturer’s information favour multivitamins and prenatal vitamins. A higher proportion of participants who rely on Health Canada approval (21%) and review articles (21%) selected homeopathic products as the most frequently recommended NHPs compared to participants who rely on manufacturer’s information (14%), the primary literature (11%) and client requests (14%).
The number of hours spent on accredited and non-accredited NHP-related learning did not alter observed recommendation trends. Vitamin D and calcium remained the top recommendations when this variable was introduced. Among participants who selected homeopathic products as the most frequently recommended NHPs (n = 28), 11 (39%) have spent greater than 10 hours on accredited or non-accredited NHP learning.
Prevalence of NHP practice among pharmacists
Our findings indicate that pharmacy care relating to NHPs is prevalent among community pharmacists in Alberta and may even be considered integral to their practice. A majority of pharmacists involved in the study (276; 68%) routinely or occasionally recommend NHPs to clients, while, conversely, very few (11; 3%) have never recommended NHPs. This finding suggests that pharmacists have embraced a role in facilitating access to NHPs, which are, for the most part, regulated health products. This role may include helping consumers understand the evidence base for NHPs. Conversely, by undertaking this role, pharmacists may also be facilitating public demand for products that lack good quality or well-established evidence to support safe or effective uses [8–22]. Such involvement in facilitating access may, in turn, undercut the view that pharmacy is an evidence-based profession practiced by professionals who are trained to administer products that have been rigorously and scientifically tested to ensure that they are safe and effective for public use. These findings also raise questions about the extent to which pharmacists should be involved in the marketing of NHPs and about the proper role of pharmacists in community pharmacy settings where products other than pharmaceuticals are offered to the public [40–44].
Given that most, if not all, NHPs are marketed to the public over-the-counter , the involvement of pharmacists in initiating or facilitating access to NHPs may serve as clinical endorsements of NHPs and may convey the impression to the public that these products are generally clinically safe or effective for recommended uses. While solid clinical evidence may exist for some NHPs that warrant such practices, the evidence around a large number of NHPs remains understudied and unclear. This concern is mediated somewhat by the finding that a majority of pharmacists involved in the study provide counselling when recommending, dispensing or dealing with client inquiries about NHPs. However, it is unclear from our findings if such counselling addresses the evidentiary questions surrounding NHPs or if it serves as a deterrent to demand. While likely not the intention, the routine provision of counselling may serve to simply increase public confidence in NHPs.
The foregoing observations are consistent with findings of other studies dealing with attitudes and practices of community pharmacists regarding NHPs [46–47]. The pharmacists surveyed in these studies reported that consumers routinely requested information and advice on NHPs from them. The studies also found that although the pharmacists surveyed are generally open to NHPs, they perceive their role as focused mainly on ensuring patient safety by providing counselling and improving their training on NHPs [46–47]. One study found that the majority of customers who inquire about NHPs make product purchases  and that pharmacists are motivated to meet increased demand for NHPs by “stock[ing] more products” .
Impact of regulatory approval on recommendations of NHPs
A majority of participants in this study (233; 58%) stated that they only recommend NHPs that have a Health Canada product number to clients. While this finding indicates regulatory compliance, it raises serious concerns in light of the flaws in the licensing system and regulatory process. As discussed earlier, NHPs are subject to less rigorous pre-approval scrutiny and evidentiary demands compared to conventional drugs. Under applicable regulations, persons seeking to license NHPs are required to provide “information that supports the safety and efficacy of the natural health product when it is used in accordance with the recommended conditions of use” . However, unlike conventional drugs, the supporting information need not be comprised of preclinical or clinical trial data showing that the product is safe or efficacious. Rather, pre-market review of NHPs is based on a system of risk assessment that considers the “level of certainty” associated with the product’s “established safety and efficacy profile” . NHPs that have a high level of certainty, i.e. a “well-established safety and efficacy profile,” face less scrutiny that those that have a medium or low level of certainty. Health Canada regulations and policies are generally unclear on what constitutes a “well-established safety and efficacy profile,” but will accept a variety of forms of supporting evidence depending on the product’s certainty profile and intended use, including Phase I—III randomized controlled trials, meta-analysis, observational studies, prospective and retrospective studies, evidence of decision from another regulatory agency, systematic reviews, narrative reviews that cite primary evidence, epidemiological studies, published compilations referring to traditional use, pilot and open label studies, reputable textbooks and product demonstrations . The diversity of options for supporting evidence works favourably for the introduction of NHPs that are not evidence-based into the market .
The finding that a majority of recommendations are based on the problematic licensing system is somewhat attenuated by the fact that a low number of participants (48; 12%) rely on Health Canada approval as the primary or sole basis for recommending NHPs. However, a noteworthy number/proportion of participants are either unsure that they have recommended licensed NHPs (122; 30%), or have recommended unlicensed products to clients (46; 11%). Both findings indicate non-compliance with or lack of knowledge of regulatory requirements and suggest a need for education on licensing and regulatory requirements for NHPs.
Reliance on the Natural Medicines Comprehensive Database (NMCD)
The NMCD is a reputable resource that employs an evidence-based approach to assigning effectiveness and safety ratings to NHPs for specific indications . The NMCD is the Pharmacy Examining Board of Canada approved resource for NHPs. As such, it is logical and appropriate that most pharmacists in this study (283; 70%) identified it as their primary resource relied on when counselling pharmacy patrons about NHPs. Conversely, it is concerning that only three participants in the study rely on the NMCD as the primary basis for recommending NHPs to clients.
The effectiveness ratings provided by the NMCD are based on the quantity and quality of available evidence. The NMCD advises that only NHPs with the combined ratings of “effective” and “likely safe” or “likely effective” and “likely safe” should be recommended to patients . NHPs are rated as “effective” if they have clinical evidence of effectiveness for a specific indication that is consistent with or equivalent to passing a regulatory review by the FDA, Health Canada or equivalent body and are supported by two or more high quality non-biased randomized clinical trials or meta-analyses including several hundred to several thousand patients. A rating of “likely effective” means that the NHP meets the same criteria as “effective” but has not passed a regulatory review and is supported by clinical trials involving several hundred patients. Safety ratings in the NMCD are based on similar criteria. It should be noted that in this study, we did not seek to explore or establish how pharmacists interpret the safety and effectiveness ratings in the NMCD or how they apply such ratings in the clinical context. It is also unclear from our study whether pharmacists recommend NHPs that do not meet the combined ratings endorsed by the NMCD. However, our study does suggest the need for further research exploring these matters, particularly in light of the finding that a majority of pharmacists in our study rely on the NMCD when counselling clients about NHPs.
One concern that emerges from the finding that pharmacists rely on the NMCD for counselling on NHPs surrounds the reliability of the rating system. The use of regulatory approvals in assigning ratings is particularly problematic given the questions raised earlier around the rigor of such approvals. Our examination of specific product ratings in the NMCD also revealed some inconsistencies between the stated rating and the evidence used to support the rating. For example, calcium (one of the top NHPs recommended by pharmacists in our study) is rated in the NMCD as “effective” for the reversal of hyperkalemia when administered intravenously . However, a review of the studies used to support the rating makes it clear that calcium does not reverse hyperkalemia and is only effective for the treatment of ECG changes that may occur due to hyperkalemia [53–55]. Also, although calcium is listed as FDA-approved for hyperkalemia , it is not clear if the “effective” rating is merely based on such approval or on the supporting studies, which are mainly review articles and summaries of the evidence. Regardless, the rating appears to be inaccurate with regard to the specific indication and could result in misleading recommendations and incorrect clinical uses of calcium.
Recommendations and clinical benefit
This study did not examine indications for which specific NHPs are recommended or specific categories of patients to whom recommendations are made. While the questions regarding NHP recommendations and indications allowed for open-ended responses, we should caution that there is no way to determine from the study results whether the NHP recommendations by the study participants are correlated with the reported indications. Thus, our findings should not be interpreted as establishing that the study participants recommend any of the listed or identified NHPs for any of the listed or identified indications. However, given the open-ended nature of the responses to the questions regarding NHP recommendations and indications, it is worth asking if there is any credible evidence of significant clinical benefit from using the recommended NHPs to treat or address indications listed or identified in the study findings. Our limited review of the literature suggests that available evidence of clinical benefit from the recommended NHPs is generally low or of substandard quality, or based on studies plagued with issues of poor design, publication bias and limited participant enrolment [56–59]. Most of the NHPs included in this study have not been found to provide any clinical benefits in randomized, double-blind clinical studies. Vitamin D, the most recommended NHP in this study, has been shown to provide clinical benefit when used to treat vitamin deficiencies, but there is little to no evidence that it provides any clinical benefits when used to treat other conditions . Calcium, another commonly recommended NHP, has been shown to reduce the risk of early onset pre-eclampsia, but only in women with low calcium intake [56,61]. However, a recent review of clinical studies of calcium supplementation for the prevention of pre-eclampsia concluded that the utility of the supporting evidence is limited due to issues with trial design and publication bias . Based on our findings, we recommend that further research be undertaken to assess the clinical uses and benefits of the recommended NHPs in the study findings.
Pharmacists in Alberta are required under applicable standards of practice to “offer assistance to… patient[s] who wish to purchase…health care product[s],” including NHPs (see Standard 9)  and our findings confirm compliance with this requirement. However, issues surrounding the credibility and utility of supporting evidence for clinical recommendations of the NHPs included in our study raise questions regarding the role that pharmacists should play in the marketing of such products, all of which are sold over-the-counter in community pharmacies. The involvement of pharmacists in marketing NHPs may serve to legitimize clinical applications of products that may not provide clinical benefits for the indications they purport to treat. While it is possible that the actual involvement of pharmacists is limited to informing patients about the available evidence for clinical uses of specific NHPs or about safe use of NHPs, our findings suggest that our participants’ roles extend to initiating the clinical encounter and making recommendations.
Inappropriate and anomalous practices around NHPs
A very small number of pharmacists involved in the study (28; 7% of participants) selected homeopathic products as their most frequently recommended NHPs. While this finding cannot be interpreted as demonstrating any significant trends, it is extremely worrisome given that there is virtually no credible scientific evidence to support clinical recommendations of homeopathic products. Existing systematic reviews of clinical research on a variety of homeopathic remedies conclude that they offer no statistically significant treatment or health effects and that there is no evidence of efficacy for the various indications tested [62–63]. There is also a notable lack of high quality randomized controlled trials or other clinical research studies designed to assess the safety and efficacy of homeopathic remedies, and available studies are mainly poorly designed, of low quality, and unreliable [64–66].
While the specific basis for recommending homeopathic products cannot be established from our findings, it is doubtful that the recommendations are based on reputable evidence-based sources such as the Canadian Pharmacist’s Letter and peer-reviewed journal articles, which were selected by study participants as the top two sources upon which their recommendations are based. One possible source is reliance on the fact that the products have been issued a DIN-HM (i.e. a Health Canada product number). As previously discussed, a majority of pharmacists in this study (233; 58%) only recommend NHPs that have received a Health Canada product number to clients. Given that evidence or information to support recommendations of homeopathic products is either non-existent or not readily available (the NMCD, for example, does not contain any entries for homeopathic products), it is likely that pharmacists simply rely on the Health Canada “seal of approval” as a basis for recommending this category of products. As noted earlier, reliance on Health Canada product numbers as a basis for recommending NHPs is less than ideal given the issues associated with regulatory oversight and approval of NHPs and may be even worse in relation to homeopathic products.
Another factor that may be driving recommendations is a trend towards aggressive marketing of homeopathic products by community pharmacies. Most major Canadian pharmacy chains currently have dedicated product displays for homeopathic and naturopathic remedies, often times located next to the pharmacy. The location and availability of these products, combined with client inquiries and requests, may have some influence in driving recommendations by pharmacists.
A related and potentially problematic finding is that participants who selected homeopathic products as their top recommendation have also spent ten hours or greater on accredited or non-accredited NHP learning. This finding suggests that learning about NHPs may not necessarily alter clinical practices around NHPs, including practices and recommendations that one might expect to be addressed by further learning, such as the lack of evidence for efficacy in relation to homeopathic remedies. Indeed, the number of hours spent on accredited and non-accredited NHP-related learning did not have any significant impacts on recommendation trends observed in the study. While no conclusions regarding the type or quality of further learning about NHPs can be drawn from these findings, the data does suggest a need to evaluate the quality of continuing education on NHPs that pharmacists receive.
The concept of integrative medicine, which seeks to combine the best evidence in both Western and complementary and alternative medicine for the delivery of optimal health care, is growing in popularity in health care and health education [67–68]. The finding that 8% of participants in our study have provided care to clients who present recommendations or prescriptions of NHPs from their primary care providers reflects this trend. Under an integrative medicine approach, NHPs with a strong research infrastructure are incorporated into therapeutic modules to help pharmacists determine what role or benefit NHPs may have alongside conventional drugs. The finding that the majority of pharmacists in this study (339; 84%) would recommend using NHPs concurrently with conventional drugs is consistent with an integrative approach. At the same time, the approach and trend suggested by this finding is concerning when considered against the lack of evidence regarding the safety and interaction potential of NHPs. Such interactions can be antagonistic or synergistic in nature, but clinical interpretation is still needed in both cases. While some NHPs, such as St. John’s wort (Hypericum perforatum), have a reasonably well-established safety profile , credible clinical evidence on the safety profiles of most NHPs is missing or unclear. Pharmacists who recommend concurrent use of NHPs and conventional drugs may therefore be exposing their clients to safety risks associated with drug-NHP interactions.
The finding that 125 participants (31%) recommend NHPs as an alternative to conventional drugs is also consistent with this integrative approach. However, such recommendations pose potential risks to clients who may forgo proven treatments in favour of NHPs that do not have an established safety or efficacy profile, including the risk of not receiving timely or appropriate treatment. The latter risk is highlighted or illustrated by a recent case involving an Alberta toddler who died of bacterial meningitis after the parents opted to forgo medical treatment with antibiotics in favour of treating him with NHPs, including echinacea, one of the NHPs included in our study [70–71]. Recommendations of alternative use may also be inconsistent with the pharmacist’s expertise and scope of practice. Pharmacists presently do not receive any significant training in the pharmacologic, pharmacokinetic and safety profiles of NHPs and it is doubtful that they possess sufficient expertise and information to recommend NHPs in place of conventional drugs. Also, it is not clear to what extent such alternative use recommendations are backed by full patient histories related to NHP use, safety data around NHPs and potential interactions with conventional drugs. These findings, at a minimum, suggest a need to evaluate the role of pharmacists in the context of integrative approaches to health care. They further suggest that it is imperative that pharmacists receive training and continuing education on existing and emerging clinical trends and evidence on NHPs. The standards of pharmacy practice in Alberta currently do not specifically require such training or continuing education. As such, the development of NHP-focused continuing education policies should be made a priority, as this will help pharmacists make appropriate and safe recommendations of NHPs.
Given the cross-sectional nature of this study, we are unable to assume or determine the factors driving the practices reported by our participants, or to offer further interpretation. Further research exploring pharmacists’ beliefs and attitudes regarding specific NHPs will be valuable and will further understanding of clinical trends and issues surrounding pharmacy care relating to NHPs.
Given the study design, respondent bias is likely to have played a role as those who chose to respond to the study may be more interested in NHPs or more likely to recommend them in their practice setting. While we were able to capture eight percent (8%) of licensed pharmacists (403/4896) in the province of Alberta in Canada through this survey, other important differences may exist that we are unable to generalize from our study sample.
The growing consumer demand for NHPs implicates pharmacy practice in certain fundamental respects. NHPs are typically marketed or sold in community pharmacies and pharmacists, by virtue of their “front line” role in the pharmacy setting, are both expected and required by their professional practice guidelines to provide care relating to NHPs to their clients. This study sought to establish the views and practices of pharmacists in Alberta in regards to NHPs offered to the public in community pharmacies. The study findings indicate a high prevalence of pharmacy care relating to NHPs among study participants. Although pharmacists’ practices around NHPs are consistent with the existing licensing framework, we found some involvement in problematic practices that necessitate further research and potential policy scrutiny.
The authors would like to thank the Alberta College of Pharmacists, Ken Cor and Alessandro Marcon for research assistance and support. The authors are also grateful to the two anonymous reviewers for their very helpful comments and suggestions. Special thanks to Ravina Sanghera-Grewal for assistance with survey development.
- Conceptualization: UO CN.
- Data curation: UO CN.
- Formal analysis: UO CN.
- Funding acquisition: UO CN.
- Investigation: UO CN.
- Methodology: UO CN.
- Project administration: UO CN.
- Resources: UO CN.
- Software: UO CN.
- Supervision: UO CN.
- Validation: UO CN.
- Visualization: UO CN.
- Writing – original draft: UO CN.
- Writing – review & editing: UO CN.
- 1. Health Canada. About Natural Health Products [Internet]. [cited 2016 Jun 24]. Available: http://www.hc-sc.gc.ca/dhp-mps/prodnatur/about-apropos/cons-eng.php
- 2. Singh SR, Levine MAH. Natural health product use in Canada: analysis of the National Population Health Survey. Can J Clin Pharmacol. 2006;13(2):e240–50. pmid:16921199
- 3. Levine MAH, Xu S, Gaebel K, Brazier N, Bédard M, Brazil K, et al. Self-reported use of natural health products: a cross-sectional telephone survey in older Ontarians. Am J Geriatr Pharmacother. 2009 Dec;7(6):383–92. pmid:20129259
- 4. Harris PE, Cooper KL, Relton C, Thomas KJ. Prevalence of complementary and alternative medicine (CAM) use by the general population: a systematic review and update. Int J Clin Pract. 2012 Oct;66(10):924–39. pmid:22994327
- 5. Reid Ipsos. Natural Health Product Tracking Survey– 2010 Final Report [Internet]. Health Canada; 2011 Jan [cited 2016 Jun 24]. Available: http://epe.lac-bac.gc.ca/100/200/301/pwgsc-tpsgc/por-ef/health/2011/135-09/report.pdf
- 6. Godwin M, Crellin J, Mathews M, Chowdhury NL, Newhook LA, Pike A, et al. Use of natural health products in children: survey of parents in waiting rooms. Can Fam Physician. 2013 Aug;59(8):e364–71. pmid:23946043
- 7. Pike A, Etchegary H, Godwin M, McCrate F, Crellin J, Mathews M, et al. Use of natural health products in children: qualitative analysis of parents’ experiences. Can Fam Physician. 2013 Aug;59(8):e372–8. pmid:23946044
- 8. Roe AL, Paine MF, Gurley BJ, Brouwer KR, Jordan S, Griffiths JC. Assessing Natural Product–Drug Interactions: An End-to-End Safety Framework. Regulatory Toxicology and Pharmacology. 2016 Apr;76:1–6. pmid:26776752
- 9. Gromek K, Drumond N, Simas P. Pharmacovigilance of herbal medicines. Int J Risk Saf Med. 2015;27(2):55–65. pmid:26410008
- 10. Jordan SA, Cunningham DG, Marles RJ. Assessment of herbal medicinal products: challenges, and opportunities to increase the knowledge base for safety assessment. Toxicol Appl Pharmacol. 2010 Mar 1;243(2):198–216. pmid:20018204
- 11. Brazier NC, Levine MAH. Drug-herb interaction among commonly used conventional medicines: a compendium for health care professionals. Am J Ther. 2003 Jun;10(3):163–9. pmid:12756423
- 12. Necyk C, Tsuyuki RT, Boon H, Foster BC, Legatt D, Cembrowski G, et al. Pharmacy study of natural health product adverse reactions (SONAR): a cross-sectional study using active surveillance in community pharmacies to detect adverse events associated with natural health products and assess causality. BMJ Open. 2014;4(3):e003431. pmid:24682573
- 13. Vohra S, Cvijovic K, Boon H, Foster BC, Jaeger W, LeGatt D, et al. Study of natural health product adverse reactions (SONAR): active surveillance of adverse events following concurrent natural health product and prescription drug use in community pharmacies. PLoS ONE. 2012;7(9):e45196. pmid:23028841
- 14. Coghlan ML, Maker G, Crighton E, Haile J, Murray DC, White NE, et al. Combined DNA, toxicological and heavy metal analyses provides an auditing toolkit to improve pharmacovigilance of traditional Chinese medicine (TCM). Sci Rep. 2015;5:17475. pmid:26658160
- 15. Breeher L, Mikulski MA, Czeczok T, Leinenkugel K, Fuortes LJ. A cluster of lead poisoning among consumers of Ayurvedic medicine. Int J Occup Environ Health. 2015 Oct;21(4):303–7. pmid:25843124
- 16. Newmaster SG, Grguric M, Shanmughanandhan D, Ramalingam S, Ragupathy S. DNA barcoding detects contamination and substitution in North American herbal products. BMC Med. 2013;11:222. pmid:24120035
- 17. Holstege CP, Mitchell K, Barlotta K, Furbee RB. Toxicity and drug interactions associated with herbal products: ephedra and St. John’s Wort. Med Clin North Am. 2005 Nov;89(6):1225–57. pmid:16227061
- 18. Ephedra [Internet]. National Center for Complementary and Integrative Health; [cited 2016 Jun 24]. Available: https://nccih.nih.gov/health/ephedra
- 19. Drug Record: Black Cohosh (Actaea Racemosa) [Internet]. United States National Library of Medicine; [cited 2016 Jun 24]. Available: http://livertox.nih.gov/BlackCohosh.htm
- 20. Tang BMP, Eslick GD, Nowson C, Smith C, Bensoussan A. Use of calcium or calcium in combination with vitamin D supplementation to prevent fractures and bone loss in people aged 50 years and older: a meta-analysis. Lancet. 2007 Aug 25;370(9588):657–66. pmid:17720017
- 21. Henrotin Y, Mobasheri A, Marty M. Is there any scientific evidence for the use of glucosamine in the management of human osteoarthritis? Arthritis Research & Therapy. 2012;14(1):201.
- 22. Towheed T, Maxwell L, Anastassiades TP, Shea B, Houpt J, Welch V, et al. Glucosamine therapy for treating osteoarthritis. Cochrane Database Syst Rev. 2005;(2):CD002946. pmid:15846645
- 23. Felix S. 2015 OTC Market Report: Top categories. Pharmacy Practice Plus [Internet]. 2015 Apr 24 [cited 2016 Jun 24]; April 2015. Available: http://www.canadianhealthcarenetwork.ca/pharmacists/magazines/pharmacy-practice-plus/april-2015/2015-otc-market-report-top-categories-31254
- 24. Felix S. Innovation drives natural health products. Pharmacy Practice Plus [Internet]. 2013 Apr 21 [cited 2016 Jun 24]; April 2013. Available: http://www.canadianhealthcarenetwork.ca/pharmacists/your-business/manage-your-drugstore/innovation-drives-natural-health-products-20561.
- 25. Smith A, Jogalekar S, Gibson A. Regulation of natural health products in Canada. Journal of Ethnopharmacology. 2014 Dec;158:507–10. pmid:24969823
- 26. Elash A. Health Canada acknowledges 'weak evidence' for approving herbal, vitamin supplements: fifth estate: New rules have more than 90 per cent of new products approved, often within days. CBC News [Internet]. 2015 Nov 12 [cited 2016 Jun 24]. Available: http://www.cbc.ca/news/health/fifth-estate-vitamins-herbal-health-canada-1.3316208.
- 27. Health Canada. The approach to natural health products [Internet]. [cited 2016 Jun 24]. Available: http://www.hc-sc.gc.ca/dhp-mps/prodnatur/nhp-new-nouvelle-psn-eng.php.
- 28. MacDonald NE, MacLeod S, Stanbrook MB, Hebert PC, with editorial advisory team members, Flegel K, et al. No regulatory double standard for natural health products. Canadian Medical Association Journal. 2011 Dec 13;183(18):2079–2079. pmid:22083673
- 29. Grundig T. Health Canada licensing of natural remedies “a joke,” doctor says; Marketplace gets licence for children’s fever remedy with no scientific evidence. CBC News [Internet]. 2015 Mar 12 [cited 2016 Jun 24]; Available: http://www.cbc.ca/news/health/health-canada-licensing-of-natural-remedies-a-joke-doctor-says-1.2992414.
- 30. Health Canada. Nosodes and children’s cough, cold and flu homeopathic products Labelling Changes [Internet]. Government of Canada; 2015 [cited 2016 Jun 24]. Available: http://healthycanadians.gc.ca/recall-alert-rappel-avis/hc-sc/2015/54460a-eng.php?_ga=1.144068477.978851503.1456341372.
- 31. Giveon SM, Liberman N, Klang S, Kahan E. Are people who use “natural drugs” aware of their potentially harmful side effects and reporting to family physician? Patient Education and Counseling. 2004 Apr;53(1):5–11. pmid:15062898
- 32. Cellini M, Attipoe S, Seales P, Gray R, Ward A, Stephens M, et al. Dietary supplements: physician knowledge and adverse event reporting. Med Sci Sports Exerc. 2013 Jan;45(1):23–8. pmid:22811037
- 33. Mehta DH, Gardiner PM, Phillips RS, McCarthy EP. Herbal and Dietary Supplement Disclosure to Health Care Providers by Individuals with Chronic Conditions. The Journal of Alternative and Complementary Medicine. 2008 Dec;14(10):1263–9. pmid:19032071
- 34. Kennedy J, Wang C-C, Wu C-H. Patient Disclosure about Herb and Supplement Use among Adults in the US. Evidence-Based Complementary and Alternative Medicine. 2008;5(4):451–6. pmid:18955213
- 35. Howell L, Kochhar K, Saywell R, Zollinger T, Koehler J, Mandzuk C, et al. Use of Herbal Remedies by Hispanic Patients: Do They Inform Their Physician? The Journal of the American Board of Family Medicine. 2006 Nov 1;19(6):566–78. pmid:17090790
- 36. Charrois TL, Hill RL, Vu D, Foster BC, Boon HS, et al. Community identification of natural health product drug interactions. Ann Pharmacother 2007;41(7–8):1124–29.
- 37. Felix S. 2014 OTC Market Report: OTCs a pharmacy (and consumer) cornerstone. Pharmacy Practice Plus [Internet]. 2015 Apr 2 [cited 2016 Jun 24]; April 2015. Available: http://www.canadianhealthcarenetwork.ca/pharmacists/clinical/otc/2014-otc-market-report-introduction-25930.
- 38. Alberta College of Pharmacists. Standards of Practice for Pharmacists and Pharmacy Technicians [Internet]. [cited 2016 Jun 24]. Available: https://pharmacists.ab.ca/sites/default/files/StandardsOfPractice.pdf.
- 39. National Association of Pharmacy Regulatory Authorities. National statistics–pharmacists (as of January 1, 2016) [Internet]. [cited 2016 Jun 24]. Available: http://napra.ca/pages/Practice_Resources/National_Statistics.aspx?id=2103.
- 40. Sturgess R. Is it possible to move towards a consensus on homoeopathy? Pharmaceutical Journal. 2002;269(7208):138–9.
- 41. Gavura S. Homeopathy: To sell or not to sell? Pharmacists weigh in. Science-based Pharmacy. 2011 Nov 30 [cited 2016 Jun 24]. Available: https://sciencebasedpharmacy.wordpress.com/2011/11/30/homeopathy-to-sell-or-not-to-sell-pharmacists-weigh-in/.
- 42. Beal FC. Herbals and homeopathic remedies as formulary items? Am J Health Syst Pharm. 1998 Jun 15;55(12):1266–7. pmid:9640465
- 43. Milne V, Tierney M, Caulfield T. Should pharmacies sell natural health products? healthydebate [Internet]. 2014 Nov 6 [cited 2016 Jun 24]; Available: http://healthydebate.ca/2014/11/topic/pharmacies-pharmacist-natural-health-products
- 44. Hirschkorn K, Griener G, Cali M, Boon H. The ethics of dietary supplements and natural health products in pharmacy practice: a systematic documentary analysis. International Journal of Pharmacy Practice. 2009 Feb 1;17(1):31–8. pmid:20218027
- 45. Health Canada. Natural and non-prescription health products [Internet]. [cited 2016 Jun 24]. Available: http://www.hc-sc.gc.ca/dhp-mps/prodnatur/index-eng.php.
- 46. Robinson N, Lorenc A. Responding to patient demand: community pharmacists and herbal and nutritional products for children. Phytother Res. 2011 Jun;25(6):892–6. pmid:21110397
- 47. Volmer D, Lilja J, Hamilton D, Bell JS, Veski P. Self-reported competence of Estonian community pharmacists in relation to herbal products: findings from a health-system in transition. Phytother Res. 2011 Mar;25(3):381–6. pmid:20734324
- 48. Natural Health Products Regulations, SOR/2003-196, section 5(g), Canada [Internet]. [cited 2016 Jun 24]. Available: http://laws-lois.justice.gc.ca/eng/regulations/SOR-2003-196/FullText.html.
- 49. Health Canada. Pathway for Licensing Natural Health Products Making Modern Health Claims [Internet]. [cited 2016 Jun 24]. Available: http://www.hc-sc.gc.ca/dhp-mps/prodnatur/legislation/docs/modern-eng.php#a25.
- 50. Natural Medicines Comprehensive Database [Internet]. [cited 2016 Jun 24]. Available: http://naturaldatabase.therapeuticresearch.com/home.aspx?cs=cepda&s=ND.
- 51. Natural Medicines Comprehensive Database. Confusion in the Supplement Aisle: How to Help Consumers Select Dietary Supplements [Internet]. [cited 2016 Jun 24]. Available: http://naturaldatabase.therapeuticresearch.com/ce/ceCourse.aspx?cs=cepda&s=ND&pv=1&pc=07-33&quiz.
- 52. Natural Medicines Comprehensive Database. Calcium [Internet]. [cited 2016 Jun 24]. Available: http://naturaldatabase.therapeuticresearch.com/nd/Search.aspx?cs=UAL~CEPDA&s=ND&pt=100&id=781&ds=&name=CALCIUM&searchid=55944468.
- 53. Hollander-Rodriguez JC, Calvert JF. Hyperkalemia. Am Fam Physician. 2006 Jan 15;73(2):283–90. pmid:16445274
- 54. Parham WA, Mehdirad AA, Biermann KM, Fredman CS. Hyperkalemia revisited. Tex Heart Inst J. 2006;33(1):40–7. pmid:16572868
- 55. Guidelines and Audit Implementation Network (GAIN). Guidelines for the treatment of hyperkalemia in adults [Internet]. 2014 Aug [cited 2016 Jun 24]. Available: http://www.gain-ni.org/images/Uploads/Guidelines/GAIN_Guidelines_Treatment_of_Hyperkalaemia_in_Adults_GAIN_02_12_2014.pdf.
- 56. Tang R, Tang IC, Henry A, Welsh A. Limited evidence for calcium supplementation in preeclampsia prevention: a meta-analysis and systematic review. Hypertens Pregnancy. 2015 May;34(2):181–203. pmid:25549172
- 57. Parveen A, Parveen B, Parveen R, Ahmad S. Challenges and guidelines for clinical trial of herbal drugs. J Pharm Bioallied Sci. 2015 Dec;7(4):329–33. pmid:26681895
- 58. Hopp DC. Past and future research at National Center for Complementary and Integrative Health with respect to botanicals. HerbalGram. 2015,107:44.
- 59. Kuszak AJ, Hopp DC, Williamson JS, Betz JM, Sorkin BC. Approaches by the US National Institutes of Health to support rigorous scientific research on dietary supplements and natural products: NIH approaches to DS research. Drug Testing and Analysis. 2016;
- 60. Haines ST, Park SK. Vitamin D supplementation: what’s known, what to do, and what’s needed. Pharmacotherapy. 2012 Apr;32(4):354–82. pmid:22461123
- 61. Patrelli TS, Dall’asta A, Gizzo S, Pedrazzi G, Piantelli G, Jasonni VM, et al. Calcium supplementation and prevention of preeclampsia: a meta-analysis. J Matern Fetal Neonatal Med. 2012 Dec;25(12):2570–4. pmid:22889274
- 62. Coulter MK, Dean ME. Homeopathy for attention deficit/hyperactivity disorder or hyperkinetic disorder. Cochrane Database Syst Rev. 2007;(4):CD005648. pmid:17943868
- 63. McCarney RW, Linde K, Lasserson TJ. Homeopathy for chronic asthma. Cochrane Database Syst Rev. 2004;(1):CD000353. pmid:14973954
- 64. Kassab S, Cummings M, Berkovitz S, van Haselen R, Fisher P. Homeopathic medicines for adverse effects of cancer treatments. In: The Cochrane Collaboration, editor. Cochrane Database of Systematic Reviews [Internet]. Chichester, UK: John Wiley & Sons, Ltd; 2009 [cited 2016 Jun 24]. Available: http://doi.wiley.com/10.1002/14651858.CD004845.pub2.
- 65. McCarney R, Warner J, Fisher P, Van Haselen R. Homeopathy for dementia. Cochrane Database Syst Rev. 2003;(1):CD003803. pmid:12535487
- 66. Peckham EJ, Nelson EA, Greenhalgh J, Cooper K, Roberts ER, Agrawal A. Homeopathy for treatment of irritable bowel syndrome. In: The Cochrane Collaboration, editor. Cochrane Database of Systematic Reviews [Internet]. Chichester, UK: John Wiley & Sons, Ltd; 2013 [cited 2016 Jun 24]. Available from: http://doi.wiley.com/10.1002/14651858.CD009710.pub2.
- 67. Zhang W, Hui K. Clinical practice of integrative medicine in the United States and its development in primary care. Zhongguo Zhong Xi Yi Jie He Za Zhi. 2015 Apr;35(4):394–400. pmid:26043559
- 68. Maizes V, Horwitz R, Lebensohn P, McClafferty H, Dalen J, Weil A. The evolution of integrative medical education: the influence of the University of Arizona Center for Integrative Medicine. J Integr Med. 2015 Nov;13(6):356–62. pmid:26559360
- 69. Barnes J, Anderson LA, Phillipson JD. St John’s wort (Hypericum perforatum L.): a review of its chemistry, pharmacology and clinical properties. Journal of Pharmacy and Pharmacology. 2001 May;53(5):583–600. pmid:11370698
- 70. Graveland B. Parent of toddler who died of meningitis asked Alberta naturopath for immune system boost. CBC News [Internet]. [cited 2016 Jun 24]. Available: http://www.cbc.ca/news/canada/calgary/naturopath-says-collet-stephan-asked-for-something-for-meningitis-1.3484501.
- 71. Graveland B. Alberta naturopath worker says mom of sick boy asked for something for meningitis. Calgary Sun [Internet]. [cited 2016 Jun 24]. Available: http://www.calgarysun.com/2016/03/10/alberta-naturopath-worker-says-mom-of-sick-boy-asked-for-something-for-meningitis.