The aims of this study were to investigate whether there is a gap between evidence of traditional medicine (TM) interventions in East-Asian countries from the current Clinical Practice Guidelines (CPGs) and evidence from current systematic reviews and meta-analyses (SR-MAs) and to analyze the impact of this gap on present CPGs.
We examined 5 representative TM interventions in the health care systems of East-Asian countries. We searched seven relevant databases for CPGs to identify whether core CPGs included evidence of TM interventions, and we searched 11 databases for SR-MAs to re-evaluate current evidence on TM interventions. We then compared the gap between the evidence from CPGs and SR-MAs.
Thirteen CPGs and 22 SR-MAs met our inclusion criteria. Of the 13 CPGs, 7 CPGs (54%) mentioned TM interventions, and all were for acupuncture (only one was for both acupuncture and acupressure). However, the CPGs did not recommend acupuncture (or acupressure). Of 22 SR-MAs, 16 were for acupuncture, 5 for manual therapy, 1 for cupping, and none for moxibustion and herbal medicine. Comparing the evidence from CPGs and SR-MAs, an underestimation or omission of evidence for acupuncture, cupping, and manual therapy in current CPGs was detected. Thus, applying the results from the SR-MAs, we moderately recommend acupuncture for chronic LBP, but we inconclusively recommend acupuncture for (sub)acute LBP due to the limited current evidence. Furthermore, we weakly recommend cupping and manual therapy for both (sub)acute and chronic LBP. We cannot provide recommendations for moxibustion and herbal medicine due to a lack of evidence.
The current CPGs did not fully reflect the evidence for TM interventions. As relevant studies such as SR-MAs are conducted and evidence increases, the current evidence on acupuncture, cupping, and manual therapy should be rigorously considered in the process of developing or updating the CPG system.
Citation: Cho H-W, Hwang E-H, Lim B, Heo K-H, Liu J-P, Tsutani K, et al. (2014) How Current Clinical Practice Guidelines for Low Back Pain Reflect Traditional Medicine in East Asian Countries: A Systematic Review of Clinical Practice Guidelines and Systematic Reviews. PLoS ONE 9(2): e88027. https://doi.org/10.1371/journal.pone.0088027
Editor: Sonia Brucki, University Of São Paulo, Brazil
Received: September 23, 2013; Accepted: January 2, 2014; Published: February 5, 2014
Copyright: © 2014 Cho et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Low back pain (LBP) is a common condition that affects a significant proportion of the population, with an estimated prevalence of 70%–85% . Current Clinical Practice Guidelines (CPGs) recommend various LBP treatments, such as pharmacotherapy, physical therapy, manual therapy, educational therapy, psychological therapy, and invasive therapy , .
Traditional medicine (TM) is defined as indigenous medicine used to maintain health and to prevent, diagnose, and treat physical and mental illnesses and is distinct from allopathic medicine based on theories, beliefs, and experiences . In East-Asian countries, especially China, Korea, and Japan, the main therapeutic methods of TM consist of acupuncture, moxibustion, cupping therapy, herbal medicines, and manual therapies (called Tuina in China, Chuna in Korea, and Shiatsu in Japan) . In East-Asian countries, 80% of the population depends on TM for primary health care, and 70% to 80% of the population in many developed countries has used some form of alternative or complementary medicine (e.g., acupuncture) . Although studies on the use of TM are increasing , , differences in medical circumstances, culture, or poor evidence in support of TM seem to complicate the inclusion of TM in CPGs.
CPGs are systematically developed to assist practitioners and patients in making decisions about appropriate healthcare in specific clinical circumstances . In contrast with previous approaches that were often based on tradition or authority, modern CPGs are based on an examination of current evidence within the paradigm of evidence-based medicine . SR-MAs are literature reviews focused on a research question that attempts to identify, appraise, select, and synthesize all high-quality research evidence relevant to that question. SR-MAs of high-quality randomized controlled trials (RCTs) are crucial for evidence-based medicine . Although it seems easy to write an SR-MA, good SR-MAs take time, and they frequently encounter delays but do not update the literature review. The additional typical delays for peer review and publishing add extra time, and SR-MAs may be printed two to four years after the end of the information retrieval. Finally, most SR-MAs are published worldwide without an accompanying CPG .
The purpose of this review was to investigate whether there is a gap between evidence of traditional medicine (TM) interventions in East-Asian countries from the current Clinical Practice guideline (CPGs) and evidence from current systematic reviews and meta-analyses (SR-MAs) and to analyze the impact of this gap on present CPGs.
Data Sources and Searches
Two types of databases were searched according to their database content. The first database was a CPG-related database for LBP that was used to understand the current status of LBP management. The other database included systematic reviews or meta- analyses (SR-MAs) and was used to compare the current evidence to current CPGs. Following the core, standard, ideal search (CoSI) model , we searched the following electronic databases from database inception to December 2012.
Our CPG database searches were the core searches because representative databases were more highly recommended than ideal searches. The CPG databases included the National Guideline Clearinghouse (NGC), Guidelines International Network (G-I-N), National Institute for Health and Clinical Excellence (NICE), and Scottish Intercollegiate Guidelines Network (SIGN). Additionally, we searched 3 representative East-Asian countries’ databases: the Chinese National Knowledge Infrastructure (CNKI) for China, the Korean Medical Guideline Information (KoMGI) for Korea, and the Medical Information Network Distribution Service (MINDS) for Japan.
For SR-MAs, we conducted an ideal search because all relevant SR-MAs of LBP were needed for the TM area. We found TM in the following databases: The Cochrane Database of Systematic Review (CDSR), PubMed, MEDLINE, EMBASE, DH-DATA, AMED, Chinese databases (China Knowledge Resource Integrated Database, Wanfang database, and Chinese VIP information), a Korean database (Oriental Medicine Advanced Searching Integrated System), and a Japanese database (Japan Medical Abstracts Society).
Each East-Asian country’s CPG and SR-MA databases were searched by authors from their own county.
The search keywords for CPG were (back pain OR low back pain OR lumbago) in each CPG database mentioned above. The search keywords for SR-MAs were (acupuncture OR acup*) for acupuncture, (moxa OR moxibustion) for moxibustion, (cupping) for cupping therapy, (herbal medicine OR traditional Chinese medicine OR Chinese herbal medicine) for herbal medicine, (manual therapy OR manipulation OR massage OR Chinese massage OR Tuina OR Chuna OR Shiatsu) for manual therapy, (low back pain OR back pain OR lumbago) for LBP, and (systematic review OR meta analysis OR meta analyze) for SR-MAs in each language. These search terms were combined in the form of [(LBP) AND (TM interventions) AND (SR-MA)]. This search strategy was adjusted for each database.
In addition, the bibliographies of relevant CPGs and SR-MAs were manually searched. Gray literature, consisting of theses, dissertations, letters, government documents, research reports, conference proceedings, and abstracts, was searched to avoid publication bias. The reference section for each study was searched. Personal contacts were made with the original authors of the searched studies to identify any data that were potentially missing from the publications.
The title and abstract of searched articles were read by a single primary researcher (H-WC), who conducted the screening process. Articles that were not written in English were translated into Korean or English prior to screening. The articles for potential inclusion in our review were checked by 2 independent reviewers (H-WC, E-HH). After screening the titles and abstracts retrieved in our search, we excluded all articles that did not meet our pre-defined inclusion/exclusion criteria. Then, the full text of the articles for inclusion was carefully read. The final inclusion was determined by two independent reviewers (H-WC, E-HH), who used the matching method.
Types of CPG and SR-MA.
Current CPGs regarding the treatment of non-specific LBP, which were used universally and considered the standard, were evaluated. When we conducted the preliminary search, there were few CPGs not written in English, and they were from the Netherlands, Spain, Germany, France, Finland, and Brazil. The CPGs’ development dates were relatively older than the English versions, and the relevance of their content was low. Thus, we concluded that they would have no effect on the analysis. Because we wanted to show the current state of TM through the representative CPGs, the authors reached a consensus to limit the language of the CPGs to English.
Non-specific LBP was searched and evaluated to understand the current evidence from SR-MAs research studies on the effectiveness of 5 major TM interventions (acupuncture, moxibustion, cupping therapy, manual therapy, and herbal medicine). Language was not restricted during the selection of SR and MA.
Types of participants in CPG and SR-MA.
LBP was defined as pain localized to the area between the costal margin or the 12th rib to the inferior gluteal fold. Non-specific LBP indicated the lack of a detectable specific cause, such as infection, neoplasm, metastasis, osteoporosis, rheumatoid arthritis, fracture, or inflammatory process .
The CPGs and SR-MAs in our review included all stages of non-specific LBP with or without radiating pain, such as acute (lasting up to six weeks), sub-acute (lasting six to 12 weeks), or chronic (lasting longer than 12 weeks) non-specific LBP .
Types of interventions in SR and MA.
We analyze the TM of the primary therapeutic interventions, including acupuncture, moxibustion, cupping therapy, herbal medicines, and manual therapies, found in East-Asian countries. We selected these 5 types of interventions because they were medical insurance reimbursement items in East-Asian countries .
- Acupuncture: only included needle acupuncture with or without electrical stimulation. Acupuncture without needling, such as laser or TENS on acupoints, was excluded.
- Moxibustion: included when acupoints were heated with moxibustion.
- Cupping therapy: included both dry and wet cupping.
- Manual therapy: included Tuina in China or Chuna in Korea. Massage techniques were included, such as Chinese massage, acupressure, acupuncture massage, or Shiatsu when applied to acupoints or meridians.
- Herbal medicine: included herbal medicine according to the TM diagnosis.
When studies addressed various symptoms or interventions in one acupuncture SR, we limited the inclusion criteria if the majority (>50%) of the participants and the intervention were acceptable for predefined criteria because there were numerous acupuncture SR-MAs. However, there were few available SR-MAs of moxibustion, cupping, manual therapy, and herbal medicine. Therefore, we included the SR-MAs when the RCTs of those interventions were greater than 10% of all RCTs when the data could be separately extracted.
When it was difficult to evaluate the independent effectiveness of TM intervention, such as comparing the same interventions or mixed treatments, the SR-MAs were excluded.
Data Extraction and Quality Assessment
Two reviewers (H-WC, E-HH) independently extracted the data based on predefined characteristics to describe each study (refer to Tables 1, 2). In CPG, we extracted the type of interventions, the presence of TM, and the recommendation. In SR-MAs, we extracted outcome measures and their directions of outcome for each intervention and condition of LBP.
The outcome measures that we considered are described below. SR-MAs that used at least one outcome measure related to pain were included. The other outcome measures were considered, and their inclusion may be important for the study of LBP.
- Primary outcome: Pain intensity
- Secondary outcome: Global measure of improvement or recovery/Back-specific functional status/Quality of life/Safety/Cost-effectiveness/Other outcomes
Level of Evidence and Recommendation
We reassessed the evidence level and recommendations of the SR-MAs using the SIGN grading system . All disagreements were resolved through discussion and consensus or by the first author (H-WC).
Quality Assessment of CPGs and SR-MAs
The SR-MAs of 24 different appraisal tools and some studies have shown that the Appraisal of Guidelines for Research & Evaluation (AGREE) instrument is an acceptable standard for guideline evaluation. Therefore, the AGREE Instrument for reporting the quality of CPGs was used , , and the Assessment of Multiple Systematic Reviews (AMSTAR) checklist for reporting the quality of SR-MAs was used to evaluate the methodological quality of the included publications. The AMSTAR instrument has recently been used in another study .
Four reviewers (H-WC, E-HH, K-HH, and B-CS) were fully trained in the quality assessment and data extraction methodology.
Data Synthesis and Analysis
We identified the directions for future CPG of LBP through deep discussion and expert consensus among authors. All authors were CPG-related experts from East-Asian countries (China, Korea, and Japan). The authors discussed and reached consensus through e-mail contact. In cases of disagreement, the final recommendation was made by consensus. Per the authors’ recommendations, we recommend studies based on the results in Table 1 and Table 2.
A total of 402 CPGs and 1627 SR-MAs were identified. After manually removing the duplicates and screening the titles and abstracts, 42 CPGs and 195 SR-MAs were identified as potentially relevant. After a detailed evaluation of the full text, 29 CPGs and 173 SR-MAs were excluded. Finally, 13 CPGs and 22 SR-MAs met our inclusion criteria. The literature search process is summarized in Figure 1, following the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) flow diagram. The key data are summarized in Table 1.
Current Clinical Practice Guidelines
Of the 13 CPGs, 10 originated in the USA , –, 2 were from the UK , , and 1 was from Japan . There were no CPGs from any East-Asian country. There were 7 CPGs for both (sub)acute and chronic LBP , , , , –, 1 for chronic LBP , 3 for (sub)acute LBP , , , and 2 for work-related LBP , . The CPGs addressed various interventions, such as pharmacological therapy, physical therapy, education, psychological therapy, manual therapy, and invasive therapy. However, TM interventions were only included in 7 CPGs , , , , –. All TM interventions were for acupuncture, and only 1 CPG  mentioned both acupuncture and acupressure.
Of 7 CPGs, 6 recommended acupuncture, but all of these CPGs had weak recommendation strength or made the recommendation with session limitations , , , , , . However, 3 CPGs did not recommend acupuncture for (sub)acute LBP , , . Only 1 CPG , which analyzed acupressure, did not recommend the treatment (Table 1).
Quality Assessment of Clinical Practice Guidelines
The overall assessment mean of the included CPGs was 4±1 (range: 3–6), indicating that CPGs have moderate quality. There were 2 high-quality CPGs , , 11 moderate-quality CPGs , , , –, , , and no low-quality CPGs. We assessed 2 CPGs ,  as “recommend without modification” due to high quality and 11 other CPGs as “recommend with modifications” (Table 1). In each domain, the CPGs showed comparatively more than moderate quality (Table S1).
Evidence of Systematic Review and Meta-analysis
Of 22 SR-MAs, 16 were for acupuncture –, 5 were for manual therapy (Chuna, acupressure, acupuncture massage, shiatsu) –, and 1 was for cupping therapy . For chronic LBP, 1 SR reported a moderately negative conclusion , 5 SR-MAs reported an insufficient conclusion , , , , , and 9 SR-MAs reported weakly positive effects of acupuncture , , , , –, . For (sub)acute LBP, 1 SR reported a moderate negative conclusion , 5 SR-MAs reported insufficient conclusions , , , , , and 3 SR-MAs reported weakly positive effects of acupuncture , , . The evidence level and recommendation strength were reassessed using the SIGN grading system. For the level of evidence, 5 SR-MAs were assessed 1− , , , , , 9 SR-MAs were 1+ , –, , –, , 1 SR was 2+ , and 1 SR was not applicable . For recommendation strength, 12 SR-MAs were assessed as grade A –, , –, –, 2 SR-MAs were grade B , , 1 was grade C ,and 1 was not applicable .
Only 1 SR-MA on cupping for pain, including 2 RCTs for both (sub)acute and chronic LBP, reported weakly positive conclusions. The study partially considered pain and safety (adverse effect). The evidence level was assessed to be 1−, and the recommendation strength received a grade of B .
Of 5 SR-MAs of manual therapy, 1 considered Chuna , and 4 considered acupressure (including acupuncture massage and Shiatsu) –. All of these SR-MAs were compared with other interventions and reported positive conclusions, except for an inconclusive conclusion reported in 1 study of Shiatsu . The study evidence level was assessed to be 1−, and the recommendation strength received a grade of B . In 4 studies of acupressure, 2 were on chronic LBP alone , , and the other 2 included both (sub)acute LBP and chronic LBP , . The evidence level was assessed to be 1− in 2 studies ,  and 1+ in the other 2 studies , . The recommendation strength received a grade of A in 2 studies ,  and B in the other 2 studies ,  (Table 2).
Quality Assessment of Systematic Reviews
The mean (± standard deviation) score of total quality assessment of the SR-MAs was 6.59±2.65 (range: 2–10) (Table S2). A total of 10 SR-MAs (47.6%) were assessed to be high quality , , , –, , , , , 9 SR-MAs (38.1%) were moderate quality , –, , , , , , and 3 SR-MAs (14.3%) were low quality , , (Table 2).
Directions for Future CPG of LBP
Of the 7 CPGs that included acupuncture, 2 showed a similar recommendation compared with current research on SR-MAs , , but 5 CPGs were underestimated , , , , . Only 1 CPG included manual therapy and showed effectiveness underestimation . Similar to moxibustion, cupping therapy and herbal medicine were not discussed in current CPGs and thus could not be compared.
We moderately recommended acupuncture for chronic LBP with a 1+/A evidence level and recommendation grade. However, we inconclusively recommended acupuncture for (sub)acute LBP due to the current SR-MA evidence. We weakly recommended cupping therapy for both (sub)acute and chronic LBP with a 1−/B evidence level and recommendation grade. We weakly recommend manual therapy for both (sub)acute and chronic LBP with a 1−/B evidence level and recommendation grade. Moxibustion and herbal medicine were not applicable due to the lack of data available at this time (Table 3).
The main aim of our review was to analyze TMs in East-Asian countries (China, Korea, and Japan) in the current CPGs for LBP. The results showed that TMs in East-Asian countries were not sufficiently included in current CPGs.
Notably, moxibustion, cupping therapy, and herbal medicine are not mentioned in current CPGs. The lack of eligible RCTs and the aggregation of SR of moxibustion for LBP might be the primary causes of this lack of inclusion. This omission leads to a lack of evidence for the CPG. The use of moxibustion has become more common; 67% of Korean Oriental medical doctors have used moxibustion . Additionally, 40% of health care in China is currently based on traditional Chinese medicinal approaches that include moxibustion . The adverse effects and difficulties of placebo moxibustion that are reported in the literature  may have emerged due to the limited moxibustion studies.
The relevant studies on cupping therapy were of poor quality , which might lead to a lack of inclusion in current CPGs. However, the only SR showed a positive effect for both sub(acute) and chronic LBP.
The heterogeneity of herbal medicine products may be a considerable problem. The various types of preparation and the amount of chemical constituents per dose influence the pharmacokinetics and relative efficacy of the herbal medicine . These differences may make it difficult to conduct a high-quality study.
Some acupuncture recommendations had both favorable and unfavorable conclusions. Of all of the studies, 7 CPGs (54%) mentioned acupuncture, but only 1 study recommended acupuncture for chronic LBP without use limitations. The other studies recommended acupuncture for limited treatment sessions or did not recommend acupuncture. These results demonstrate a gap with the results of current SR-MAs. Negative or insufficient effects in SR-MAs were dominant for (sub)acute LBP –, , . However, the positive effects were dominant for chronic LBP , , , , –. Similar results were reported for the evidence-based medicine approach to LBP . Therefore, we conclude that the recommendations for (sub)acute LBP seem appropriate, and the recommendations for chronic LBP are underestimated.
Regarding manual therapy, 1 CPG mentioned acupressure but did not recommend acupressure for both (sub)acute and chronic LBP. However, we found some gaps in SR-MAs. There were 5 SR-MAs with a positive result – (1 on Chuna  and 4 on acupressure or acupuncture massage –) and 1 insufficient SR on Shiatsu . Additionally, 1 related SR-MA that was not included in this study supported the possibility of Tuina-integrated treatment t for LBP . Thus, we find that the current CPGs underestimate the effectiveness of TM manual therapy for LBP.
The overall evidence available was usually published in the US and European countries, Thus, a lack of familiarity with East-Asian TM may influence the lack of interventions. These problems may explain the underpowered evidence for TM.
One important thing to consider is the need for more objective methods in TM practice. In contradistinction to classical approaches in Eastern medicine, where the methodology is much more concrete, TM is mainly considered an “art”. This understanding complicates an objective study of the results.
We also conducted a quality assessment that included CPGs and SR-MAs. The AGREE assessment showed that the quality of included CPGs was acceptable. The average scores of 5 domains (with the exception of 1 domain) were greater than 60%, and the mean score in the overall assessment was 4±1 [range: 3–6], indicating a moderate quality of CPG (Table 1). The domains of applicability obtained the lowest score, suggesting that more attention should be paid to quality enhancement during CPG development (Table S1).
The SR-MAs were assessed using the AMSTAR instrument . Although the item “Was a priori design provided?” received the lowest score, the overall scores were quite high. The total mean score showed moderate quality of 6.59 [range: 2–10] for included SR-MAs (Table S2). Therefore, future authors should conduct an a priori design to ensure better study quality.
The strength of our study is its successful completion of the first review of TM in current CPGs for LBP. Previous CPGs of Traditional Chinese Medicine  did not focus on specific diseases or make further suggestions to address the lack of evidence. To prevent this bias, we attempted to determine whether current TM interventions were adequately included in current, rigorous CPGs of LBP. Thus, we searched current available CPGs and SR-MAs with systematic search methods and assessed CPG and SR-MA quality. In this study, we reanalyzed the evidence level and grade of recommendation of SR-MAs and aimed to identify directions for future research via a CPG-related expert consensus.
Several study limitations should be considered. Despite our best efforts to retrieve all CPGs and SR-MAs on this subject, we are not convinced that our search was inclusive. Notably, the definition of manual therapy categories in Oriental medicine is a considerable problem. Because we selected the subjects for TM in East-Asian countries, there is a potential question regarding whether the 5 types of intervention represent all TM interventions. To address this problem, we selected the interventions that consider the use of traditional Chinese medicine . Although we suggested recommendation reassessments, we did not follow the entire procedure involved in crafting CPGs . Instead, we made decisions via the expert consensus method. Therefore, biased conclusions are possible.
To address these weaknesses, we suggest important recommendations for future research in this area. First, high-quality RCTs were not conducted despite the use of TM, and there is a remarkable lack of studies on moxibustion, cupping therapy, Tuina (or Chuna), and herbal medicine, which deserve increased interest and further study. Second, a broader scope of TM interventions should be searched in further studies, and accurate recommendations for TM interventions should be drawn via proper procedures by larger organizations or teams. The increasing TM evidence should be included in the process of updating CPGs, and TM interventions based on LBP CPGs should be developed in collaboration with TM experts.
Although interest in and use of TM is increasing, the CPGs identified did not fully reflect the TM interventions in East-Asian countries. In particular, acupuncture, cupping therapy, and manual therapy were underestimated or not mentioned despite their current evidence. The current evidence on acupuncture for chronic LBP and evidence on cupping and manual therapy for both (sub)acute and chronic LBP should be rigorously considered in the process of developing or updating the CPG system. However, a lack of evidence on moxibustion and herbal medicine prevented us from providing recommendations in these areas.
Assessment of Clinical Practice Guidelines (CPG) by AGREEII.
Assessment of Systematic Reviews by AMSTAR.
Conceived and designed the experiments: H-WC E-HH K-HH B-CS. Performed the experiments: H-WC E-HH. Analyzed the data: H-WC BML B-CS. Wrote the paper: H-WC. Contributed to assess the level of evidence, grade of recommendation and methodological quality of the CPGs and SR-MAs: H-WC J-PL KT. Contributed to search the CPGs and SRs from each countries: H-WC E-HH K-HH B-CS. Contributed to the consensus of recommendation of future CPGs: H-WC E-HH B-CS BML K-HH J-PL KT MS-L.
- 1. Andersson GB (1999) Epidemiological features of chronic low-back pain. Lancet 354: 581–585.
- 2. Manchikanti L, Boswell MV, Singh V, Benyamin RM, Fellows B, et al. (2009) Comprehensive evidence-based guidelines for interventional techniques in the management of chronic spinal pain. Pain Physician 12: 699–802.
- 3. SCHIN - Sowerby Centre for Health Informatics at Newcastle (2009) Back pain - low (without radiculopathy) (Prodigy).
- 4. World Health Organization Media Centre (2012) “Traditional medicine,”. World Health Organization Media Centre.
- 5. Cheung F (2011) TCM: Made in China. Nature 480: S82–S83.
- 6. Frass M, Strassl RP, Friehs H, Mullner M, Kundi M, et al. (2012) Use and acceptance of complementary and alternative medicine among the general population and medical personnel: a systematic review. Ochsner J 12: 45–56.
- 7. Ernst E, Schmidt K, Wider B (2005) CAM research in Britain: the last 10 years. Complement Ther Clin Pract 11: 17–20.
- 8. Field MJ, Lohr KN (1990) Committee to Advise the Public Health Service on Clinical Practice Guidelines IoM. Clinical practice guidelines: directions for a new program. Washington: National Academy Press.
- 9. Graham R, Mancher M, Wolman DM, Greenfield S, Steinberg E (2011) Committee on Standards for Developing Trustworthy Clinical Practice Guidelines Institute of Medicine. Clinical Practice Guidelines We Can Trust: The National Academies Press.
- 10. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS (1996) Evidence based medicine: what it is and what it isn't. BMJ 312: 71–72.
- 11. Dijkers M (2013) Want your systematic review to be used by practitioners? Try this! KT Update 1: Available from http://www.ktdrr.org/products/update/v1n4.
- 12. Bidwell S, Jensen MF (2004) Chapter 3: Using a search protocol to identify sources of information: the COSI model. In: Topfer L-A, Auston I, editors. Etext on Health Technology Assessment (HTA) Information Resources. Bethesda, MD: National Information Center on Health Services Research and Health Care Technology (NICHSR).
- 13. Waddell G (1996) Low back pain: a twentieth century health care enigma. Spine (Phila Pa 1976) 21: 2820–2825.
- 14. Koes BW, van Tulder M, Lin CW, Macedo LG, McAuley J, et al. (2010) An updated overview of clinical guidelines for the management of non-specific low back pain in primary care. Eur Spine J 19: 2075–2094.
- 15. Park HL, Lee HS, Shin BC, Liu JP, Shang Q, et al. (2012) Traditional medicine in china, Korea, and Japan: a brief introduction and comparison. Evid Based Complement Alternat Med 2012: 429103.
- 16. Harbour R, Miller J (2001) A new system for grading recommendations in evidence based guidelines. BMJ 323: 334–336.
- 17. AGREE Collaboration (2003) Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care 12: 18–23.
- 18. MacDermid JC, Brooks D, Solway S, Switzer-McIntyre S, Brosseau L, et al. (2005) Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines. BMC Health Serv Res 5: 18.
- 19. Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, et al. (2007) Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 7: 10.
- 20. Chou R, Qaseem A, Snow V, Casey D, Cross JT Jr, et al. (2007) Diagnosis and treatment of low back pain: a joint clinical practice guideline from the American College of Physicians and the American Pain Society. Ann Intern Med 147: 478–491.
- 21. Goertz M, Thorson D, Bonsell J, Bonte B, Campbell R, et al. (2012 Jan) Institute for Clinical Systems Improvement (ICSI). Adult acute and subacute low back pain. Bloomington (MN): Institute for Clinical Systems Improvement (ICSI).
- 22. Goertz M, Thorson D, Bonsell J, Bonte B, Campbell R, et al. (2010 Nov) Institute for Clinical Systems Improvement (ICSI). Adult low back pain. Bloomington (MN): Institute for Clinical Systems Improvement (ICSI).
- 23. Hegmann K (2007) Low back disorders. Occupational medicine practice guidelines: evaluation and management of common health problems and functional recovery in workers. 2nd ed. Elk Grove Village (IL): American College of Occupational and Environmental Medicine (ACOEM).
- 24. Michigan Quality Improvement Consortium (2011 Sep) Management of acute low back pain. Southfield (MI): Michigan Quality Improvement Consortium.
- 25. Toward Optimized Practice (2009 Mar 2) Guideline for the evidence-informed primary care management of low back pain. Edmonton(AB): Toward Optimized Practice. 21 p.
- 26. University of Michigan Health System (2010 Jan) Acute low back pain. Ann Arbor (MI): University of Michigan Health System.
- 27. National Guideline Clearinghouse (2009) Occupational therapy practice guidelines for individuals with work-related injuries and illnesses. Rockville MD: Agency for Healthcare Research and Quality (AHRQ).
- 28. National Guideline Clearinghouse (2011) Low back - lumbar & thoracic (acute & chronic). Rockville MD: Agency for Healthcare Research and Quality (AHRQ).
- 29. National Collaborating Centre for Primary Care (2009 May) Low back pain. Early management of persistent non-specific low back pain. London (UK): National Institute for Health and Clinical Excellence (NICE). pp. 25.
- 30. Japanese Orthopaedic Association (2012) Clinical Practice Guideline for the Management of Low Back Pain. Tokyo: Nankodo Co., Ltd.
- 31. van Tulder MW, Cherkin DC, Berman B, Lao L, Koes BW (1999) The effectiveness of acupuncture in the management of acute and chronic low back pain. A systematic review within the framework of the Cochrane Collaboration Back Review Group. Spine (Phila Pa 1976) 24: 1113–1123.
- 32. Smith LA, Oldman AD, McQuay HJ, Moore RA (2000) Teasing apart quality and validity in systematic reviews: an example from acupuncture trials in chronic neck and back pain. Pain 86: 119–132.
- 33. Ernst E, White AR, Wider B (2002) Acupuncture for back pain: Meta-analysis of randomised controlled trials and an update with data from the most recent studies. Schmerz 16: 129–139.
- 34. Henderson H (2002) Acupuncture: evidence for its use in chronic low back pain. Br J Nurs 11: 1395–1403.
- 35. Furlan AD, van Tulder M, Cherkin D, Tsukayama H, Lao L, et al. (2005) Acupuncture and Dry-Needling for Low Back Pain: An Updated Systematic Review Within the Framework of the Cochrane Collaboration. Spine (Phila Pa 1976) 30: 944–963.
- 36. Manheimer E, White A, Berman B, Forys K, Ernst E (2005) Meta-analysis: acupuncture for low back pain. Ann Intern Med 142: 651–663.
- 37. Ammendolia C, Furlan AD, Imamura M, Irvin E, van Tulder M (2008) Evidence-informed management of chronic low back pain with needle acupuncture. Spine J 8: 160–172.
- 38. Hall H, McIntosh G (2008) Low back pain (chronic). Clin Evid (Online) 2008.
- 39. Yuan J, Purepong N, Kerr DP (2009) Effectiveness of acupuncture for low back pain: A systematic review (Spine (2008) 33, (E887–E900)). Spine (Phila Pa 1976) 34: 1630.
- 40. Trigkilidas D (2010) Acupuncture therapy for chronic lower back pain: a systematic review. Ann R Coll Surg Engl 92: 595–598.
- 41. Furlan AD, Yazdi F, Tsertsvadze A, Gross A, Van Tulder M, et al. (2012) A systematic review and meta-analysis of efficacy, cost-effectiveness, and safety of selected complementary and alternative medicine for neck and low-back pain. Evid Based Complement Alternat Med 2012: 953139.
- 42. Rubinstein SM, van Middelkoop M, Kuijpers T, Ostelo R, Verhagen AP, et al. (2010) A systematic review on the effectiveness of complementary and alternative medicine for chronic non-specific low-back pain. Eur Spine J 19: 1213–1228.
- 43. Lu SC, Zheng Z, Xue CC (2011) Does acupuncture improve quality of life for patients with pain associated with the spine? A systematic review. Evid Based Complement Alternat Med 2011: 301767.
- 44. Hutchinson AJ, Ball S, Andrews JC, Jones GG (2012) The effectiveness of acupuncture in treating chronic non-specific low back pain: a systematic review of the literature. J Orthop Surg Res 7: 36.
- 45. Hall H, McIntosh G (2008) Low back pain (acute). Clin Evid (Online) 2008.
- 46. van Tulder MW, Furlan AD, Gagnier JJ (2005) Complementary and alternative therapies for low back pain. Best Pract Res Clin Rheumatol 19: 639–654.
- 47. Imamura M, Furlan AD, Dryden T, Irvin E (2008) Evidence-informed management of chronic low back pain with massage. Spine J 8: 121–133.
- 48. Furlan AD, Imamura M, Dryden T, Irvin E (2009) Massage for low back pain: an updated systematic review within the framework of the Cochrane Back Review Group. Spine (Phila Pa 1976) 34: 1669–1684.
- 49. Robinson N, Lorenc A, Liao X (2011) The evidence for Shiatsu: a systematic review of Shiatsu and acupressure. BMC Complement Altern Med 11: 88.
- 50. Kim YC, Lee MS, Park E-S, Lew J-H, Lee B-J (2012) Acupressure for the Treatment of Musculoskeletal Pain Conditions: A Systematic Review. J Musculoskelet Pain 20: 116–121.
- 51. Moon TW, Choi TY, Park TY, Lee MS (2012) Chuna therapy for musculoskeletal pain: A systematic review of randomized clinical trials in Korean literature. Chin J Integr Med 19: 228–232.
- 52. Kim JI, Lee MS, Lee DH, Boddy K, Ernst E (2011) Cupping for treating pain: a systematic review. Evid Based Complement Alternat Med 2011: 467014.
- 53. Han CH, Shin MS, Shin SH, Kang KW, Park SH, et al. (2007) Telephone survey for grasping clinical actual state of moxibustion therapeutics in Korea. J Meridian Acupoint 24: 17–31.
- 54. Hesketh T, Zhu WX (1997) Health in China. Traditional Chinese medicine: one country, two systems. BMJ 315: 115–117.
- 55. Park JE, Lee SS, Lee MS, Choi SM, Ernst E (2010) Adverse events of moxibustion: a systematic review. Complement Ther Med 18: 215–223.
- 56. Cao H, Li X, Liu J (2012) An updated review of the efficacy of cupping therapy. PLoS ONE 7: e31793.
- 57. Gagnier JJ, van Tulder M, Berman B, Bombardier C (2006) Herbal medicine for low back pain. Cochrane Database Syst Rev: CD004504.
- 58. Dagenais S, Haldeman S (2011) Evidence-Based management of low back pain: Elsevier Health Sciences.
- 59. Kong LJ, Fang M, Zhan HS, Yuan WA, Pu JH, et al. (2012) Tuina-focused integrative chinese medical therapies for inpatients with low back pain: a systematic review and meta-analysis. Evidence-based complementary and alternative medicine : eCAM 2012: 578305–578305.
- 60. Yu WY, Xu JL, Shi NN, Wang LY, Han XJ, et al. (2011) Assessing the quality of the first batch of evidence-based clinical practice guidelines in traditional Chinese medicine. J Tradit Chin Med 31: 376–381.
- 61. Xu J, Yang Y (2009) Traditional Chinese medicine in the Chinese health care system. Health Policy 90: 133–139.
- 62. Moret L, Lefort C, Terrien N (2012) [How to write, how to implement and how to evaluate a practice guideline in order to improve quality of care?]. Transfus Clin Biol 19: 174–177.